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Preface 


The  purpose  of  this  study  was  to  develop  a  decision 
support  methodology  for  space  technology  advocacy.  Previous 
investigations  and  our  own  research  indicated  that  tradi¬ 
tional  quantitative  decision  models  inadequately  modeled  the 
space  R&D  portfolio  selection  process. 

This  report  is  limited  in  scope  to  an  analysis  of  the 
R&D  environment  and  a  description  of  the  proposed  decision 
support  methodology.  The  results  of  testing  the  validity  and 
suitability  of  the  methodology  are  also  included  in  the 
report.  The  methodology  could  be  easily  transformed  into  a 
decision  support  system. 
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Force  Space  Technology  Center  and  especially  Col  Ben  Bolton, 
LtCol  Dave  Lange,  Maj  John  Ditucci,  and  Mr.  Tim  Spinney  for 
their  sponsorship  and  advice  in  this  effort.  We  are  espe¬ 
cially  grateful  to  LtCol  Pete  Soliz  of  the  Space  Technology 
Center  for  his  unlimited  support  and  patience  in  assisting 
us  with  our  research  project.  We  are  also  appreciative  of 
Mr.  George  Husman  and  Mr.  Dave  Massey  of  the  Air  Force 
Wright  Aeronautical  Laboratories  for  their  participation  in 
this  project.  Without  the  assistance  of  all  these  people 
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Abstract 

A  decision  support  methodology  for  space  technology 
advocacy  was  developed  in  lieu  of  more  traditional  quantita¬ 
tive  decision  models  for  R&D  portfolio  selection.  An  exten¬ 
sive  review  of  the  literature  revealed  that  decision  models 
inadequately  address  the  risk  and  uncertainty  inherent  in 
RScD.  The  approach  taken  was  to  develop  a  decision  support 
methodology  that  would  assist  the  Air  Force  space  technology 
advocate  to  determine  the  strategic  and  technical  utility  of 
space  technology  issues.  To  do  this  the  R&D  environment  was 
analyzed  and  hi erarchi cal 1 y  modeled.  From  this  model  crite¬ 
ria  were  developed  that  could  be  used  in  a  worth  assessment 
of  space  technology  issues.  Using  these  criteria  the  deci¬ 
sion  maker  can  focus  on  the  strategic  appreciation  of  the 
technology  issues  and  their  relative  worth  to  military  space 
strategy  and  doctrine  and  military  space  technology. 

A  description  was  presented  of  the  information  require¬ 
ments  and  the  analytical  tool  (the  analytic  hierarchy  pro¬ 
cess)  which  could  be  used  by  the  decision  maker,  with  the 
appropriate  user  interface,  to  apply  the  criteria  in  a  worth 
assessment  of  space  technology  issues.  This  worth  assess¬ 
ment,  in  conjunction  with  an  appreciation  for  the  external 
factors  in  the  decision  situation,  allows  the  decision  maker 
to  develop  a  space  technology  advocacy  plan  that  is  based  on 
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doctrine  and  on  an  appreciation  -for  the  strategic  nature  of 
the  problem.  The  results  of  testing  the  validity,  adequacy, 
and  suitability  of  the  proposed  methodology  are  presented. 
Eight  space  technology  experts  applied  the  criteria  to  sets 
of  space  technology  issues  within  the  context  of  the  ana¬ 
lytic  hierarchy  process.  The  results  indicate  that  the 
proposed  methodology  provides  a  firm  foundation  for  develop¬ 
ment  of  a  microcomputer-based  decision  support  system. 


A  DECISION  SUPPORT  METHODOLOGY 
FOR  SPACE  TECHNOLOGY  ADVOCACY 


I .  Introduction 


Technology  itself  does  not  automatically  con¬ 
fer  military  advantages,  and  a  blind  faith  in 
technology  uncoupled  with  strategic  analysis  and 
deliberate  participation  in  the  Technological  War 
can  lead  to  disaster.  It  requires  a  deliberate 
strategy  C 187: 53. 

Background 

Space  Technology  demands  a  strategy  for  advocacy.  This 
strategy  Mould  be  a  mechanism  for  integrating  goals,  tasks, 
and  priorities  for  military  space  R&D  programs.  We  propose 
a  decision  support  methodology  for  space  technology  advocacy 
that  is  based  on  doctrine  and  technological  potentials. 
This,  we  hypothesize,  will  be  more  efficient  and  effective 
than  current  quantitative  R&D  decision  models.  This  section 
develops  our  efforts  to  model  the  space  technology  decision 
situation. 

We  began  this  research  effort  on  the  request  of  the  Air 
Force  Space  Technology  Center  (STC) .  STC  had  developed  a 
space  technology  database  and  plan  called  the  Military  Space 
Systems  Technology  Plan  <MSSTP> .  A  resource  allocation 
model  called  the  Technology  Resource  Utility  Management 
Process  (TRUMP)  was  a  set  of  decision  rules  that  used  the 
database  to  develop  resource  constrained  technology  plans. 
Initially,  our  efforts  were  directed  toward  improving  and 
expanding  the  capabilities  of  TRUMP. 


We  completed  an  extensive  survey  of  the  management 
science  literature  looking  for  R&D  resource  allocation 


models  that  might  have  application  to  our  problem.  We 
learned  that  there  are  hundreds  of  R&D  decision  models  and 
that  most  of  these  models  inadequately  address  important  R&D 
issues.  It  became  evident  that  R&D  resource  allocation 
problems  were  too  complex  to  adequately  model  with  a  quanti¬ 
tative  decision  model.  This  led  us  to  explore  decision 
support  as  an  alternative  approach  to  the  space  technology 
problem. 

Research  Problem  and  Scope 

R&D  processes  are  inherently  strategic  in  nature.  They 
are  characterized  by  multiple  and  conflicting  objectives  and 
priorities  in  an  environment  that  is  complex,  dynamic  and 
uncertain.  Furthermore,  R&D  projects  are  usually  comprised 
of  activities  which  are  by  their  very  nature  nonrepeti ti ve 
and  noncomparable,  and  therefore  information  tends  to  be 
subjective  in  nature.  Decision  models  do  not  adequately 
account  for  the  varying  degrees  of  subjectivity  in  pre¬ 
dicting  possible  outcomes.  As  Quade  C189:xiil  states 

In  concept  it  might  be  possible  to  develop  a 
clear-cut  set  of  decision  rules  that  would  apply 
to  a  set  of  specific  problems  and  use  these  rules 
to  carry  out  relevant  and  competent  analyses  to 
the  level  of  detail  needed.  In  reality,  however, 
we  find  this  completely  impossible  and  believe 
that  it  will  never  be  possible. 

Along  these  same  lines.  Shannon  C218:2461  states  that 
the  inability  to  completely  understand  the  dynamics  of  both 
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the  problem  and  the  decision-making  process  prevents  us  -from 
designing  systems  or  models  that  successfully  aid  the 
deci si on-maker . 

One  remedy  for  this  deficiency  in  the  techniques  is  to 
increase  the  sophistication  of  the  models  (i.e.  the  ability 
to  handle  more  complexity)  by  interfacing  the  decision  maker 
with  some  powerful  analytical  techniques  into  a  decision 
making  team.  The  analytical  techniques  must  provide  the 
decision  maker  with  a  mechanism  to  deal  with  the  inherently 
subjective  nature  of  R&D  decision  situations.  This  is  best 
done  through  decision  support.  Decision  support  is  a  way  to 
structure  the  problem  so  that  the  decision  maker  can  more 
easily  and  rapidly  consider  the  data  and  make  better 
informed  judgments  which  hopefully  lead  to  better  decisions. 

Our  proposed  decision  support  methodology  for  use  by 
the  Air  Force  Space  Technology  Advocate  is  designed  to 
provide  the  following  features  [116:146—1473:  meaningful 
reduction  of  available  information;  aid  to  eliciting  subjec¬ 
tive  preferences  and  judgments;  better  insight  into  the 
various  value  judgments;  inclusion  of  differences  in 
interest  and/or  political  views;  alternative  modeling  of  the 
R&D  process;  aid  to  substantially  better  considered  deci¬ 
sions;  aid  to  better  group  decisions  and  interaction;  more 
controllable  position  of  the  Space  Technology  Advocate;  more 
justifiable  basis  for  policy  decisions;  and  a  microcomputer 
based  decision  making  aid. 


Research  Approach  and  Presentation 

We  develop  a  space  technology  advocacy  model  (Figure  1- 
1)  that  depicts  the  important  interactions  in  the  space 
technology  advocacy  decision  situation.  From  a  comprehen¬ 
sive  description  of  the  space  R&D  decision  environment  we 
develop  criteria  with  which  to  evaluate  the  strategic  and 
technical  utility  of  space  technology  issues.  Strategic  and 
technical  utility  is  defined  to  be  the  worth  of  a  technology 
issue  in  the  context  of  its  possible  contribution  to  mili¬ 
tary  space  strategy  and  doctrine  and  its  contribution  to 
space  technology.  The  decision  support  methodology  allows 
the  decision  maker  to  assess  the  relative  worth  of  space 
technology  issues  by  considering,  through  an  appropriate 
user  interface,  the  criteria  and  relevant  information  using 
an  appropriate  analytical  technique.  The  analytical  tech¬ 
nique  (the  Analytic  Hierarchy  Process)  provides  a  mechanism 
for  the  decision  maker  to  evaluate  the  subjective  judgments 
of  space  technology  experts.  The  decision  maker  can  then 
consider  external  factors  before  presenting  his  space  tech¬ 
nology  advocacy  plan. 

Chapter  Two  of  this  thesis  is  a  comprehensive  summary 
of  the  available  literature  on  risk  and  uncertainty,  elici¬ 
tation  of  subjective  preferences,  and  R8cD  portfolio 
selection  models.  We  first  discuss  the  strategic  nature  of 


R&D  processes  and  emphasize  the  characteri sti cs  (risk  and 
uncertainty)  that  most  complicate  the  analyses  from  an 
operations  research  or  management  science  perspective. 
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Figure  1-1.  Space  Technology  Advocacy  Model 

Next,  we  discuss  how  subjective  judgments  are  elicited  and 
used  in  R&D  decision  models.  Finally,  we  present  R&D  deci¬ 
sion  models  and  show  that  these  models  inadequately  address 
the  complexity  of  R&D  decision  processes.  Decision  support 
provides  an  alternative  approach  to  modeling  the  R&D 
process. 

Chapter  Three  is  a  detailed  discussion  of  the  MSSTP  and 
TRUMP.  First,  the  elements  of  the  MSSTP  and  TRUMP  are 
presented  followed  by  a  discussion  of  STC’s  attempts  to 
implement  MSSTP  and  the  eventual  abandonment  of  TRUMP  as  a 
resource  allocation  model.  Throughout  this  chapter  we  focus 


on  the  problems  with  quantitatively  modeling  a  complex 
process  in  an  uncertain  environment. 

Chapter  Four  focuses  on  the  linkage  between  doctrine 
and  space-rel  ated  R8<D.  We  present  a  more  expanded  descrip¬ 
tion  of  the  space  R&D  environment.  Several  environmental 
factors  are  discussed  which  ultimately  tie  the  R&D  process 
to  satisfying  national  interests. 

In  Chapter  Five  we  present  a  hierarchical  structure  to 
model  the  space  R&D  process.  From  this  model  we  develop 
three  criteria  for  evaluating  the  strategic  and  technical 
utility  of  space  technology  issues.  We  show  the  linkage 
between  this  hierarchical  structure  and  the  space  R&D 
advocacy  model  (Figure  1-1). 

Chapter  Six  discusses  the  information  requirements,  the 
analytical  tools,  and  user  interface  of  the  space  R&D 
advocacy  model.  We  describe  the  database,  database  manage¬ 
ment  system,  and  the  information  required  to  make  space 
technology  issue  assessments.  Next,  we  show  how  the 
Analytic  Hierarchy  Process  can  be  used  to  elicit  the  subjec¬ 
tive  judgments  of  space  technology  experts.  The  user 
interface  is  addressed  in  the  context  of  guidelines  for 
transforming  the  decision  support  methodology  into  a  com¬ 
puter-based  decision  support  system. 

In  Chapter  Seven  the  results  of  an  exercise  in  which 
several  space  technology  experts  used  our  proposed  model  to 
evaluate  space  technology  issues,  are  presented.  The 
participants’  responses  to  a  questionnaire  are  discussed. 


In  Chapter  Eight  we  present  results  and  implications  of 
our  research  effort.  Based  on  these  results,  we  reach  some 
conclusions  concerning  our  proposed  decision  support  method¬ 
ology.  These  conclusions  tie  in  with  our  recommendations 
for  future  research. 


Military  (space)  technology  should  begin  with 
strategic  appreci ation.  The  strategic  apprecia¬ 
tion  provides  the  strategist  with  an  estimate  of 
the  probable  outcome  of  present  trends,  and  allows 
him  to  form  judgments  about  the  future  require¬ 
ments  and  capabilities  for  military  technology. 
It  thus  forms  the  first  step.  The  second  step 
comes  from  the  scientific  community  in  the  form  of 
possible  or  probable  developments  in  the  world  of 
technology  1187:64—663. 


Introduction 


Our  review  of  the  literature  was  first  oriented  towards 
identifying  the  various  methodologies  that  have  been  devel¬ 
oped  to  support  R&D  acquisition  and  resource  allocation 
decisions.  We  extensively  examined  the  management  science 
literature  to  identify  quantitative  decision  models  that 
might  have  application  to  the  space  technology  advocacy 
problem.  Concurrent 1 y ,  we  initiated  a  DTIC  (Defense  Techni¬ 
cal  Information  Center)  search  to  determine  what  efforts  had 
already  been  taken  within  the  DoD  and  other  governmental 
agencies  to  manage  the  risk  and  uncertainty  in  defense 
related  R&D  programs.  At  the  same  time  we  began  an  indepth 
analysis  of  the  Military  Space  Systems  Technology  Plan 
(MSSTP,  covered  in  Chapter  Three). 

Our  research  showed  there  were  many  problems  with  quan¬ 
titative  approaches  to  analyzing  R&D  processes.  While 
hundreds  of  models  have  been  suggested,  there  is  no  consen¬ 
sus  within  the  management  science  community  as  to  which 
models  or  categories  of  models  are  best  for  analyzing  R8cD 
related  problems.  We  learned  that  R&D  processes  are  partic¬ 
ularly  difficult  to  model  because  of  their  inherent 
complexities.  We  then  reoriented  our  research  to  determine 
the  nature  of  these  complexities. 

Following  this  reorientation  we  learned  that  R&D 
processes  are  strategic  in  nature.  They  are  sequentially 


staged;  in  the  early  stages  operating  in  an  environment  of 
great  uncertainty,  unspecified  organizational  goals,  and  no 
analytical  database  from  which  to  project  future  outcomes. 
As  R&D  efforts  progress  over  time,  the  environment  changes, 
with  more  information  becoming  available  from  which  to  base 
more  accurate  predictions  and  forecasts.  Thus  R&D  processes 
are  dynamic  and  vary  in  degrees  of  uncertainty.  Because  of 
the  great  uncertainty  prevalent  in  the  early  stages  of  these 
processes,  most  decisions  are  based  on  subjectively  derived 
data,  elicited  in  a  variety  of  ways.  We  then  directed  our 
efforts  into  determining  how  uncertainties  were  handled 
within  this  context.  We  learned  once  again  that  there  is  no 
consensus  among  management  scientists  on  the  very  definition 
of  uncertainty,  or  how  best  to  apply  quantitative  analyses 
to  account  for  uncertainty.  Furthermore,  while  most  authors 
agreed  that  subjective  judgments  were  the  primary  source  for 
estimates  of  uncertainty,  there  was  no  agreement  on  how  best 
to  elicit  these  judgments. 

Ultimately  our  research  led  us  to  conclude  that  because 
of  these  complexities,  one  must  first  define  the  decision 
situation  and  environment  and  then  define  the  appropriate 
decision  support  structure  within  which  to  analyze  the 
problem.  Since  the  primary  objective  is  to  identify  high 
priority  space  technology  issues,  we  needed  a  decision  sup¬ 
port  structure  that  adequately  models  the  early  stages  of 
the  R&D  process  where  uncertainties  are  more  numerous  and 
subjective  inputs  more  critical.  This  drove  our  effort 


towards  developing  a  suitable  methodology  that  captures 
subjective  judgments  in  an  environment  of  high  uncertainty 
and  little  quantitative  data. 

This  chapter  represents  a  summary  analysis  of  our 
literature  research.  In  the  interest  of  brevity,  we  have 
intentionally  kept  the  discussion  concise.  Where  applica¬ 
ble,  we  indicate  other  sources  which  expand  on  points  made 
in  our  discussion.  We  first  discuss  the  strategic  nature  of 
R&D  processes  and  emphasize  the  characteristics  that  most 
complicate  the  analyses  from  an  operations  research  or 
management  science  perspective.  Uncertainty,  which  is  one 
of  these  characteri sties,  is  treated  in  some  detail.  Not 
only  do  uncertai nt i es  contribute  to  the  complexity  of  ana¬ 
lyzing  R&D  processes,  but  attempts  to  "quantify"  variables 
whose  attributes  are  unknown  must  be  based  on  the  elicita¬ 
tion  of  subjective  judgments.  This  naturally  leads  into  a 
discussion  of  how  subjective  judgments  are  addressed  in  the 
management  science  literature  and  some  of  the  documented 
problems  with  their  application  to  quantitative  R&D  decision 
models. 

Next,  we  present  the  results  of  our  research  into  the 
various  categories  of  management  science  methodologies  that 
have  been  suggested  or  used  to  model  R&D  processes.  We 
discuss  the  major  characteri sti cs,  advantages,  and  disadvan¬ 
tages  of  each  category.  We  show  that  there  is  no  consensus 
among  management  scientists  or  users  concerning  which  is  the 
best  approach,  or  whether  quantitative  decision  models  are 


useful  at  all  in  analyzing  complex  R&D  processes.  Me  con¬ 
clude  that  given  the  great  uncertainties  inherent  in  the 
early  stages  of  R&D  processes,  an  acceptable  methodology  for 
capturing  subjective  preferences  is  essential. 

This  leads  into  a  discussion  of  methodologies  we 
reviewed  designed  to  elicit  subjective  judgments  from 
decision  makers.  Me  explored  two  in  some  detail  —  multiat— 
tribute  utility  theory  <MAUT>  C1373  and  the  analytic 
hierarchy  process  (AHP)  C198;  2031.  Me  ultimately  settled 
on  the  AHP  as  the  best  overall  approach  for  capturing  sub¬ 
jective  preferences,  according  to  criteria  we  set  forth. 

Finally,  we  discuss  the  benefits  of  applying  the  AHP 
within  the  context  of  a  decision  support  methodology  whereby 
the  appropriate  information  and  the  AHP  are  interfaced  with 
the  decision  maker  in  order  to  aid  him  in  making  better 
informed  judgments  about  space  technology  issues. 

The  Strategic  Nature  of  R&D  Processes 

R&D  processes  are  concerned  with  the  acquisition  and 
allocation  of  resources  applied  to  R&D  efforts  to  maximize 
future  benefits  accruing  to  an  organization.  Me  categorize 
models  intended  to  select  R&D  programs  or  research 
approaches  to  meet  specified  goals  over  a  given  planning 
horizon  as  "R&D  Portfolio  Selection”  models.  For  a  business 
whose  future  depends  on  successful  development  of  competi¬ 
tive  products,  R&D  Portfolio  Selection  models  may  be 
intended  to  provide  management  with  a  recommended  list  of 


research  efforts  which  will  maximize  profits  in  some  future 
timeframe.  In  the  military,  these  models  may  be  used  to 
identify  technologies  that  provide  the  greatest  potential 
military  utility  to  satisfy  future  performance  needs. 

The  general  class  of  decisions  that  involve  the  acqui¬ 
sition  and  allocation  of  resources  to  maximize  future 
benefits  can  be  considered  “strategic"  if  interactions 
between  the  decisions,  the  organization,  and  its  environment 
must  be  taken  into  account  in  analyzing  or  describing  the 
process  [99:121;  213:340].  Several  authors  describe  the  R&D 
process  as  complex  because  they  are  inherently  strategic  in 
nature  [55;  79;  99].  However,  all  agree  that,  despite  this 
complexity,  it  is  vital  to  an  organization  to  develop  a 
technical  strategy  that  links  long-range  research  with  the 
corporate  objectives  C32;  33;  61;  62;  70;  87;  100;  147;  172; 
178;  191;  217;  225;  274;  275;  283;  285].  Chiu  and  Gear  C55] 
list  four  characteristics  of  strategic  R&D  processes. 

The  first  characteristic  is  that  R&D  processes  involve 
“a  variety  of  factors,  some  technical  but  others  organiza¬ 
tional,  behavioral,  and  economic”  [55:2].  Obviously,  this 
characteristic  is  not  unique  to  R&D  processes.  Many  other 
strategic  management  processes  must  also  contend  with  these 
factors.  However,  several  authors  cite  the  particular 
interactions  between  technologists  and  managers  in  their 
attempts  to  formulate  organizational  goals  early  in  the  R&D 
process.  For  example,  McClarey  [164]  discusses  that  the 
difficulties  in  managing  military  R&D  are  often  due  to  upper 


level  managers  failing  <  ’  accurately  translate  their  under¬ 
standing  of  corporate  objectives  and  goals  into  the 
technical  environment.  He  also  points  out  that  the 
scientists,  engineers,  and  technologists  often  feel  that 
they  should  decide  wh.  ^roiects  should  be  undertaken  by 
the  organization,  since  they  have  the  technical  expertise 
[164:1-23.  Rubenstein  and  Schroder  [194  3  and  Hogarth  and 
Makridakis  [1201  address  the  impact  of  organizational, 
situational,  and  personal  variables  on  the  RScD  process. 
They  point  out  many  of  the  biases  and  complex  interactions 
between  individuals  at  various  levels  within  and  outside  the 
organization  involved  with  the  RSeD  process.  Peters  and 
Waterman  [1851  state  that  RScD  must  be  "externally  focused" 
to  consider  needs  and  demands  from  outside  the  organization 
[185:1571.  Many  other  references  also  address  the  inherent 
complexities  involved  with  interactions  between  these 
factors  [17;  79;  114;  129;  130;  149;  160;  172;  181;  185; 
192;  212;  232;  235;  238;  2391. 

The  existence  of  multiple  and  conflicting  objectives 
and  priorities  at  various  levels  in  the  organization  is  the 
second  characteristic  cited  by  Chiu  and  Gear  [55:21.  Like 
the  first,  this  characteristi c  is  not  particularly  unique  to 
R&D  processes.  Several  authors  describe  the  inherent 
conflict  in  allocating  resources  for  RScD  and  other  organiza¬ 
tional  interests  [32;  100;  185;  217;  2751.  Alternatives 
are  difficult  to  specify  in  any  detail  early  in  the  RScD 
process  [181:2761  and  RScD  output  is  difficult  to  measure 


since  it  is  dependent  on  individuals  more  so  than  the  equip¬ 
ment  used  E 164: 23.  In  general,  upper  level  managers  are 
reluctant  to  expend  resources  -for  speculative  R&D  that  may 
or  may  not  reap  future  benefits  for  the  organisation.  On 
the  other  hand,  the  emphasis  on  R&D  should  be  on  fast  moving 
technologies  of  generic  interest  for  meeting  corporate 
objectives,  technologies  with  payoffs  that  extend  beyond  the 
horizon  of  current  operations,  and  promising  ideas  for  which 
technical  feasibility  is  in  doubt  and  risk  is  high.  Hence, 
there  is  this  inherent  conflict  within  organizations  over 
resource  allocations  to  R&D  and  other  interests  of  the 
organization  £275:383. 

A  third  characteri stic  described  by  Chiu  and  Gear  is 
the  sequentiality  of  complex  interactions  between  projects 
and  with  the  "outside  world"  £55:23.  Gillespie  and  Gear 
emphasize  that  the  time  scale  of  strategic  decisions  is 
usually  measured  in  years,  which  makes  it  difficult  to 
correlate  outcomes  with  earlier  forecasts  and  decisions. 
They  further  state  that  strategic  decision  processes  follow 
a  sequence  over  time  as  the  organization  adapts  to  changing 
circumstances  £99:1213.  Albala  £143  notes  that  R&D  projects 
progress  sequentially  through  stages,  with  early  stages 
being  characterized  by  uncertainty  and  qualitative  judg¬ 
ments,  while  later  stages  can  be  analyzed  quantitatively  as 
more  data  are  collected  and  processed.  He  also  hypothesizes 
that  different  methodologies  should  be  used  to  analyze  R&D 
processes  at  each  of  the  various  stages,  that  no  one  method 


is  suitable  for  evaluating  the  entire  process  [14:153;  1561. 
Moore  and  Taylor  [1753  similarly  categorize  R&D  processes  as 
multi-staged,  citing  problem  definition,  research  activity, 
solution  proposal,  prototype  development,  and  solution 
implementation  as  -five  distinct  stages  common  to  all  R8cD 
projects  C 175: 4023.  Others  also  address  the  sequential 
nature  of  R&D  processes  [95;  146;  2123. 

The  final  character i sti c  identified  by  Chiu  and  Gear  is 
the  varying  degree  of  subjectivity  involved  in  predicting 
outcomes  of  actions  and  estimating  related  probabilities 
[55:23.  A  consensus  of  authors  maintain  that  the  key 
element  that  sets  R&D  processes  apart  from  other  strategic 
problems  is  the  inherent  degree  of  uncertainty  C24;  55;  72; 
79;  97;  99;  129;  1923.  Uncertainty  exists  in  how  decision 
makers  at  all  levels  perceive  probabilities  for  success 
C99:l213,  and  how  they  perceive  future  economic,  ecological, 
social,  political  and/or  technological  conditions  [20:243. 
The  anticipated  benefits  from  a  project,  the  resources  re¬ 
quired,  and  overall  resource  availability  are  all  subject  to 
varying  degrees  of  uncertainty  [153:B5813.  The  only  way 
analysts  have  found  thus  far  to  incorporate  these  uncertain¬ 
ties  in  their  models  has  been  to  solicit  subjective  esti¬ 
mates  from  decision  makers  and  R&D  personnel  [20;  99:121; 
108:281;  153;  194:1383.  Subjective  estimates  are  generally 
biased  and  tend  to  be  inaccurate  and  unreliable  [39;  79; 
109;  120;  194;  2123. 

In  summary,  R&D  processes  are  strategic  in  nature.  As 


such,  they  are  complex,  dynamic,  and  uncertain.  For  the 
most  part,  predictions  of  outcomes  and  future  conditions  are 
based  on  subjective  judgments  which  attempt  to  estimate  the 
various  uncertainties  that  are  inherent  in  R&D  processes, 
especially  in  their  early  stages.  In  the  next  section  we 
explore  uncertainty  in  more  detail.  We  show  that  while  many 
models  attempt  to  account  -for  uncertainty,  there  is  no 
consensus  among  analysts  on  definitions  or  treatments  -for 
uncertainty  when  evaluating  R&D  processes. 

Risk  and  Uncertainty.  Is  There  a  Difference? 

As  we  showed  in  the  last  section,  R&D  processes  operate 
in  an  environment  o-f  great  uncertainty.  Treatment  o-f  risk 
and  uncertainty  is  a  major  concern  within  industry  and  the 
DoD,  as  evidenced  by  the  number  o-f  symposiums  that  have 
addressed  the  subject  over  the  last  several  years  and  the 
proliferation  of  risk  assessment  models  that  purport  to 
manage  cost,  schedule,  and  performance  risk.  And  yet  our 
research  showed  that  there  i s  no  consensus  among  the  experts 
on  operational  definitions  for  risk  and  uncertainty  1123; 
125;  126;  129;  1923.  Many  authors  use  the  terms  inter¬ 
changeably  C40;  64;  84;  133;  195;  2793,  improperly  C20; 
2863,  or  ignore  uncertainty  altogether  C82;  93;  1933. 
Furthermore,  while  a  number  of  risk  assessment  models  exist, 
their  use  is  not  widespread  within  the  DoD  R&D  community 
C125;  139;  211;  2873.  Several  authors  stated  that  not 


understanding  or  accounting  for  the  distinction  between  risk 


and  uncertainty  in  quantitative  models  ultimately  leads  to 
inaccurate  and  unreliable  final  results.  This  may  partially 
explain  why  these  models  are  not  used  more  widely  C125; 
1923. 

In  this  section  we  develop  an  operational  definition 
for  both  risk  and  uncertainty  and  provide  examples  of 
specific  uncertainties  that  are  characteri sti c  of  R&D 
processes.  We  also  highlight  some  general  drawbacks  of 
methods  designed  to  “quantitatively  assess"  uncertainty. 

Risk  and  uncertainty  are  defined  by  many  authors  in 
probabilistic  terms  till;  126;  129;  1923.  From  classical 
probability  theory,  risk  can  be  defined  as  the  condition 
where  each  decision  of  the  decision  maker  leads  to  one  of  a 
set  of  specific  outcomes,  each  occurring  with  a  known  proba¬ 
bility.  Likewise,  uncertainty  can  be  defined  as  a  situation 
where  the  probabilities  of  the  various  outcomes  are  com¬ 
pletely  unknown.  Under  conditions  of  "extreme  uncertainty", 
the  outcomes  themselves  may  not  be  knowable,  or  may  not  be 
anticipated  if  knowable  £129:1653. 

Risk  has  been  operationally  defined  in  various  ways, 
but  the  most  accepted  definition  we  found  was  that  risk 
represented  the  level  of  consequences  of  a  wrong  decision 
and  could  be  determined  by  multiplying  the  probability  of 
failure  with  the  consequences  of  that  failure  for  any  given 
goal  C93;  126;  192;  1933.  This  concept  of  risk  is  the  basis 
for  decision  analysis  from  which  expected  payoffs  are  calcu- 


1 ated . 


the  probabilities  of  flipping  a  coin 


For  example, 


and  coming  up  heads  is  known  to  be  0.5.  If  I  am  offered 
five  dollars  for  a  “heads"  (and  nothing  if  the  coin  toss 
results  in  a  "tails")  or  a  dollar  if  I  do  not  flip  at  all, 
then  I  can  calculate  my  expected  payoff  as  (0.5) ($5)  or 
$2.50.  When  I  compare  this  with  t!.e  dollar  I  get  if  I  do 
not  flip  the  coin  at  all,  and  assuming  I  was  not  a  risk 
averter,  then  I  would  choose  to  flip  the  coin  and  take  my 
chances  on  winning  $5.  More  complex  and  detailed  analyses 
can  be  performed  as  well,  so  long  as  the  probabilities  are 
known  (or  can  be  determined)  for  each  of  the  possible 
outcomes. 

Uncertainty  is  not  so  easily  defined  in  operational 
terms.  The  reason  for  this  is  fairly  straightf orward.  If 
we  adopt  the  classical  definition  from  probability  theory, 
then  we  have  no  way  to  measure,  estimate,  or  otherwise 
quantify  variables  whose  probability  distributions  are 
unknown.  And  yet,  any  attempt  to  more  clearly  specify 
uncertainty  would  be  the  same  thing  as  saying  you  know 
something  about  the  unknowable  —  a  clear  inconsistency. 
Nonetheless,  several  analysts  operationally  define  uncer¬ 
tainty  as  those  situations  in  which  "potential  outcomes 
cannot  be  described  in  terms  of  objectively  known  probabil¬ 
ity  distributions"  1111:2171  or  as  the  "relative  unpredict¬ 
ability  of  an  outcome  of  a  contemplated  action"  C 192: 103. 
Others  still  choose  to  ignore  uncertainty  altogether  in 
their  analyses  of  R&D  processes  C133;  149;  2793. 

Lilge  Cl 50 3,  in  his  evaluation  of  TRACE,  a  methodology 
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provides  an 


used  by  the  Army  for  managing  R&D  programs, 
excellent  discussion  on  this  quandary  of  how  to  operational¬ 
ly  define  uncertainty.  He  quotes  Gene  Fisher  [150:51,  who 
offered  the  following  definition: 

Oftentimes  probability  distributions  are  assigned 
to  uncertain  situations,  but  these  are  of 
necessity  subjective  in  nature.  That  is,  they  are 
based  on  the  personal  judgment  and  experience  of 
the  analyst,  the  decision  maker,  or  someone  else 
regarding  the  relative  "likelihood"  of  unknown 
events.  They  are  not  based  on  incontrovertible 
empirical  or  theoretical  derivations...  If  the 
latter  were  the  case,  we  would  be  dealing  with  a 
risky  situation  and  the  distribution  would  be 
called  an  objective  probability  distribution 
[150:51. 

Lilge  further  points  out  that  if  this  definition  is 
taken  literally,  uncertainty  analysis  would  be  impossible, 
since  distributions  for  uncertain  situations  derived  from 
subjective  judgments  are  not  based  on  "incontrovertible 
empirical  or  theoretical  derivation"  [150:71.  Lilge  con¬ 
tends  that  the  problem  can  be  circumvented  by  aggregating 
unknowns  and  deriving  probability  distributions  from  an 
analysis  of  historical  data  without  reference  to  the  specif¬ 
ic  unknowns  [150:81.  In  other  words,  uncertain  variables 
are  "clumped"  together  and  a  probability  distribution  is 
determined  by  analyzing  historical  data  that  includes  the 
aggregate  affects  of  the  unknown  variables.  Thus  uncertain¬ 
ty  can  be  analytically  treated  the  same  as  risk.  This  is  in 
fact  how  several  methodologies  handle  uncertainty.  Several 
examples  of  this  class  of  methodologies  are  TRACE  [15;  25; 


107;  1501 


VERT  [37;  1731,  PROMAP  V  [841,  and  DARPA  Risk 


Assessment  C126;  127;  168;  169;  2213. 


There  are  some  inherent  problems  with  even  this  opera¬ 
tional  definition,  as  we  point  out  shortly.  To  maintain  the 
essence  of  uncertainty,  we  elect  to  use  the  definition  cited 
above  by  Fisher,  who  notes  that  of  necessity,  probability 
distributions  are  often  assigned  uncertain  information,  but 
that  these  are  subjectively  derived  and  will  not  stand  up  to 
the  rigors  of  probability  theory. 

As  we  mentioned  earlier,  R&D  processes  are  frought  with 
uncertai nt i es,  especially  in  their  early  stages.  It  is 
beyond  our  scope  to  address  all  of  the  types  cited  in  the 
literature.  However,  some  excellent  survey  articles  are 
available  that  describe  most  in  some  detail  C125;  192;  2873. 
We  briefly  describe  a  few  of  the  more  important  uncertain¬ 
ties  that  impact  the  R&D  process. 

Rowe  and  Somers  C1923  in  an  excellent  survey  article  on 
the  history  of  risk  and  uncertainty  in  the  DoD  discuss  a 
variety  of  uncertainties  that  impact  the  R&D  and  acquisition 
processes.  Somers  C2323  relates  these  in  a  causal -integra¬ 
tive  model  that  depicts  the  interactions  between 
uncertainties  and  other  environmental  factors.  The  uncer¬ 
tainty  factors  described  by  Rowe  and  Somers,  which  were 
developed  originally  by  the  USAF  Academy  Risk  Analysis 
Study,  are  internal  program  uncertainty,  technical  uncer¬ 
tainty,  process  uncertainty,  and  target  uncertainty.  Each 
is  discussed  below. 

Internal  program  uncertainty  deals  with  the 
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way  in  which  the  program  is  organized,  planned  and 
managed.  Several  types  o-f  uncertainty  exist 
within  this  -factor  alone,  namely,  uncertainty  o-f 
the  initial  estimate  and  its  impact  on  program 
management,  uncertainty  in  the  acquisition 
strategy  and  outcome,  uncertainty  in  resources 
needed,  -flexibility,  or  lack  o-f  contingency  plans. 

Also,  competing  demands,  including  conflict 
between  reliability,  vulnerability  and 
maintainability  with  performance  and  operating 
costs  are  addressed  under  this  category. 

Technical  uncertainty  covers  the  feasibility 
of  developing  the  system  at  all,  including  the 
degree  of  technical  difficulty.  It  generally 
starts  with  an  optimistic  estimate  of  the  state- 
of-the-art  and  often  leads  to  a  slippery  technical 
basel i ne. 

Process  uncertainty  deals  with  the 
sensitivity  to  changes  in  the  external  environment 
such  as  changes  in  priorities  or  policies  and 
budget  considerations.  The  unavailability  of 
funding  or  other  resources  when  they  are  needed, 
the  effects  of  inflation  and  government 
regulation,  and  the  uncertainty  in  the  criteria 
that  are  used  for  changes  add  to  process 
uncertainty. 

Target  uncertainty  is  the  uncertainty  in 
meeting  performance,  cost  or  schedule  goals  and 
determination  of  needs  as  well  as  the  uncertainty 
in  translating  abstract  needs  into  concrete 
specifications.  The  problem  of  early  estimates 
which  are  seldom  revised  is  one  example  of  target 
uncertainty  1192:8-91. 

Many  other  authors  include  elements  of  the  above 
uncertainties  in  their  discussions.  For  example,  cost 
uncertainty  is  frequently  listed  as  a  separate  category  E2B; 
107;  125;  133;  2111,  as  is  schedule  uncertainty  C28;  401. 
However,  the  four  categories  listed  above  capture  the 
majority  of  uncertainties  prevalent  in  acquisition  and  R&D 
processes. 

We  mentioned  earlier  that  one  method  that  many  models 


use  to  account  for  uncertainties  is  to  aggregate  all  unknown 
variables  into  a  single  distribution  and  estimate  distribu¬ 
tion  parameters  based  on  analysis  of  historical  data.  There 
are  two  problems  with  this  approach.  The  first  is  that  it 
often  takes  too  much  time  and  effort  to  collect  the  data 
necessary  to  make  meaningful  analyses  [99:128;  107:69—70; 
125:613.  Secondly,  and  perhaps  more  importantly,  R&D  pro¬ 
grams  are  normally  unique,  no  two  are  alike  in  every 
respect,  and  historical  data  (if  available)  may  not  be  a 
good  indicator  from  which  to  draw  any  useful  conclusions 
[14:153;  24:125;  39:15;  55:7;  79:109;  107:72;  168;  1691. 

This  leads  back  to  the  use  of  subjective  judgments  for 
deriving  probability  distributions  for  unknown  (uncertain) 
variables.  Most  risk  assessment  and  R&D  portfolio  selection 
models  use  subjective  judgments,  elicited  in  a  variety  of 
ways.  Once  again,  however,  there  is  no  consensus  among 
management  scientists  on  how  best  to  elicit  subjective 
judgments  and  account  for  biases,  or  whether  eliciting 
subjective  judgments  is  even  worthwhile  C49;  79:109; 
194:137;  238:483.  The  next  section  addresses  these  points. 

Subjective  Judgments  and  Subjective  Probabilities 

Subjective  inputs  are  extremely  difficult  to  quantify 
because  they  basically  represent  the  feelings  of  the  deci¬ 
sion  maker  "as  to  the  relative  importance  of  a  set  of 
criteria  each  of  which  can  be  attributed  to  each  of  a  set  of 


alternative  options  in  varying  degrees"  [96:113. 


A  large 


number  of  authors  use  the  term  "subjective  probability"  to 
represent  "degrees  of  belief  and  state  of  mind"  £53:327; 
79:108;  97:72;  10*?:  12;  139:2001.  An  operational  definition 
of  subjective  probability  is  provided  by  Budnick,  et.  al . 
£44:7041: 

An  approach  to  the  assignment  of  probabili¬ 
ties  is  to  use  subjective  opinion.  This  procedure 
allows  for  the  translation  of  the  experience  and 
feelings  of  the  decision  maker  into  an  estimate  of 
the  likelihood  of  occurrence  of  an  event.  This 
form  of  "educated  guessing"  can  be  effective  in 
actual  practice,  for  example,  determining  odds  for 
sporting  events  ("Jimmy  the  Greek"?)  and  the  esti¬ 
mation  of  success  levels  for  new  products  by  brand 
managers . 

Chesley  £53:3261  provides  a  more  formal  definition  when 
he  states  that  "subjective  probabi 1 i ties  are  a  measure  of 
the  confidence  that  a  particular  individual  has  in  the  truth 
of  a  particular  proposition." 

In  general,  subjective  probabilities  are  the  result  of 
a  transform  that  converts  qualitative  judgments,  opinions 
and  beliefs  into  numerical  values  that  should  represent  the 
decision  maker's  evaluation  of  the  probabi 1 i t i es  of  success, 
occurrence,  failure,  etc.  of  an  event.  Subjective  probabil¬ 
ities  became  the  quantitative  measures  of  "feelings"  or 
uncertainties  that  allow  analysts  to  mathematically  model 
R&D  processes. 

Considerable  research  attempted  to  provide  a  theoreti¬ 
cal  basis  for  proving  the  validity  of  subjective  probabili¬ 
ties.  Chesley  £531  authored  an  excellent  survey  article  on 
the  subject.  However,  many  still  argue  that  the  axioms  of 


rationality  have  not  been  met  C 129: 166;  1851  and  that  biases 
will  adversely  affect  the  accuracy  or  consistency  of  subjec¬ 
tive  judgments  C109:14;  120:117;  194:137;  238:361.  A 
detailed  discussion  o-f  the  various  points  and  counterpoints 
can  be  -found  in  the  references.  Again,  there  is  no 
consensus  on  the  ultimate  validity  o-f  subjective  probabili¬ 
ties  as  a  reliable  indicator  o-f  "real  world"  occurrences 
C39: 15;  129:166;  194:142;  238:481. 

It  is  worthwhile,  however,  to  note  that  many  methodolo¬ 
gies  attempt  to  quantify  subjective  preferences.  Subjective 
judgments  are  elicited  in  various  ways  C28;  53;  79;  133; 
2121.  The  most  prevalent  methods  are:  direct  interview  with 
experts  or  responsible  individuals  to  solicit  their 
"feelings"  concerning  probable  outcomes;  review  of  available 
historical  records  for  similar  activities;  delphi-type 
approaches  to  solicit  group  preferences;  and  multiple 
estimates  to  fit  to  a  Beta  distribution  1212:44-451.  Of  the 
four  mentioned,  the  multiple  estimate  method  seems  to  be  the 
most  widely  used  C28;  36;  82;  133;  2211.  We  do  not  include 
in  our  discussion  here  methodologies  designed  specifically 
to  elicit  utility  functions  to  represent  preferences.  This 
subject  is  covered  later  in  the  discussion  on  methods  to 
elicit  the  subjective  preferences  of  decision  makers. 

Unfortunately,  most  models  fail  to  accurately  solicit 
or  project  subjective  probabilities  C24;  79;  94;  109;  139; 
1941.  As  noted  by  Ebert,  "depending  on  the  sensitivity  of 
the  decisions  to  errors  in  subjective  estimates,  the 


ultimate  success  or  failure  of  a  project  may  depend  on  the 
quality  of  subjective  estimates"  [79:1083.  The  key  factor 
in  successfully  using  subjective  probabilities  then  is  to 
ensure  high  quality  initial  subjective  estimates.  This  is 
where  most  models  fail  [79;  99;  139;  194;  234;  2373. 

Rubenstein  and  Schroder  [1943  state  that  two  serious 
problems  relating  to  the  subjective  character  of  these 
probabilities  contribute  to  the  low  acceptance  of  models. 
First,  there  is  the  problem  of  the  low  reliability  and 
validity  of  probability  assessments  —  the  degree  of 
association  with  actual  projected  outcomes.  Secondly,  the 
subjective  probabilities,  by  their  very  nature,  may  vary 
from  person  to  person  and  thus  lack  uniqueness  [194:1371. 

Hogarth  and  Makridakis  [120:1253  in  an  excellent  survey 
article  on  forecasting  and  planning  note  that: 

Before  one  can  articulate  a  probability 
number  which  really  reflects  his  true  appraisal, 
he  has  to  "know"  how  he  feels.  Becoming  aware  of 
one’s  own  true  feelings  is  by  itself  a  very 
heuristic  process.  It  involves  self  realization 
and  self  awareness  of  one’s  inner  value  system  of 
feelings  and  sentiments. 

Solicitation  of  feelings  concerning  an  individual’s 
value  systems  and  beliefs,  including  those  motivations  that 
the  assessor  himself  may  not  be  cognizant  of,  can  be  a  very 
difficult  task.  Several  authors  note  that  oftentimes 
solicited  data  is  biased  and  unreliable  [24:125;  120:1273. 
Biases  can  also  be  generated  by  external  factors. 
Rubenstein  and  Schroder  [1943  list  several  and  comment  that 
biases  and  "interpersonal  differences  are  the  joint  effect 
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o-f  personal,  organizational,  and  situational  variables" 
[194:1383.  Hogarth  and  Makridakis  [1203  provide  an  in-depth 
analysis  of  information  process  biases  and  address  37  sep¬ 
arate  biases  -found  in  various  stages  o-f  modelling  the  R&D 
process.  Much  of  the  literature  indicates  that  biases,  and 
the  modeler’s  failure  to  properly  account  for  them,  are  the 
leading  causes  for  poor  subjective  probability  estimates. 

Unfortunately,  there  is  no  consensus  in  the  literature 
on  how  best  to  counter  biases,  or  even  if  they  should  be 
countered  at  all.  Advocates  of  scoring  techniques  Cl;  79; 
893  state  that  differences  between  actual  subjective  proba¬ 
bilities  and  "communicated"  (biased)  subjective  probabili¬ 
ties  can  be  quantitatively  measured  and  corrected.  Not  all 
agree  with  this  position  [72;  97;  1203.  Even  if  biases 
could  be  adequately  accounted  for,  scoring  may  not  be  a 
valid  method  since  the  technique  calls  for  a  feedback  and 
evaluation  phase,  which  is  dependent  on  collection  of  past 
performance  data.  Since  each  R&D  program  is  unique, 
applying  past  data  to  current  programs  may  be  misleading 
[55:73. 

Other  techniques  ignore  the  question  of  bias  altogeth¬ 
er,  stating  that  simple  quantitative  methodologies  such  as 
linear  or  stochastic  programming  give  adequate  results  in 
spite  of  the  uncertainty  of  subjective  probabilities  [49; 
97;  1203.  One  author  states  that  decisions  made  on  the 
basis  of  poor  and  biased  estimates  are  likely  to  be  bad  with 
or  without  a  model.  However,  he  goes  on  to  say  that  the 


adoption  of  a  model  leads  to  consistency  —  both  of  data 
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inputs  and  of  decisions.  With  time  and  patience  this  very 
consistency  of  method  may  lead  to  a  pinpointing  of  both  the 
errors  of  estimation  and,  more  importantly,  the  reasons  for 
them"  £153:B5893.  There  are  many  other  experts  who  believe 
mathematical  models  cannot  accurately  account  for  uncertain¬ 
ty  and  that  emphasis  should  instead  be  given  to  the  process 
by  which  inputs  are  solicited  £20;  72;  90;  1623.  Chesley 
£533  provides  a  comprehensi ve  discussion  of  elicitation 
techniques  and  concludes  that  the  nominal  group  method  is 
the  best  overall  for  accounting  for  biases  where  group 
interaction  tends  to  negate  individual  dominance  and  other 
biases.  However,  when  considering  group  assessment,  Chesley 
says  several  factors  should  be  considered,  including  the 
cost  of  assembling  a  group,  1 eader-f ol lower  relations,  game 
theoretic  strategies,  the  problem  of  reaching  a  consensus, 
and  the  distribution  of  risks  £53:3333.  Gustafson,  et.  al . 
£1083  document  the  results  of  statistical  experiments  that 
clearly  show  the  superiority  of  nominal  groups  over  Delphi 
and  interacting  groups.  Nominal  group  members  first  esti¬ 
mate  individually,  then  discuss  their  results  and  then 
estimate  as  individuals  one  last  time.  This  allows  for  the 
benefits  of  group  discussion  and  avoids  the  detractions  of 
potential  bias  or  influence  from  group  members.  Several 


other  authors  cite  the  nominal  group  method  (or  variants)  as 
the  best  methodology  for  soliciting  subjective  probabilities 


In  summary,  there  is  no  consensus  in  the  literature 
on  how  best  to  deal  with  subjective  judgments  and  probabili¬ 
ties.  There  is  unanimous  agreement,  however,  that  a  great 
amount  of  descriptive  work  remains  to  be  done  in  the  area  of 
uncertainty  and  subjective  probability  estimation.  "So  far 
no  one  has  succeeded  in  describing  the  realities  of  R  and  D 
project  selection  in  a  thorough  and  detailed  manner" 
E24: 1253. 

Decision  Models  for  R&D  Portfolio  Selection 

R&D  portfolio  selection  problems  are  difficult  to  model 
because  of  the  uncertainty  associates  with  R&D  programs. 
Uncertainty  is  usually  quantified  hy  converting  the  decision 
maker’s  feelings,  beliefs  and  opinions  into  subjective 
probabilites  —  numerical  values  that  can  be  entered  into  an 
appropriate  mathematical  model.  However,  because  feelings 
are  difficult  to  accurately  communicate  and  because  of 
external  and  internal  biases,  subjective  estimates  are  fre¬ 
quently  found  to  be  less  than  adequate.  In  the  minds  of 
many  analysts,  this  tends  to  negate  the  value  of  quantita¬ 
tive  decision  models  for  R&D  portfolio  selection  problems. 
Others  believe  that  decision  model  results  are  still  valid, 
despite  inherent  uncertainties  and  biases  on  the  part  of 
probability  estimators. 

To  avoid  confusion  we  distinguish  between  decision 
models  discussed  in  this  section  and  decision  support,  which 
is  discussed  in  the  next  section.  Decision  models  are 
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designed  to  accept  input  data  and  then  calculate  or  output 
"the  optimal  answer"  or  R&D  port-folio.  On  the  other  hand, 
decision  support  is  designed  only  to  improve  the  effective¬ 
ness  of  the  decision  maker  by  supporting,  rather  than 
replacing,  managerial  judgment  [136:13.  Decision  support 
does  not  output  an  "optimal  answer. “ 

According  to  Albala  [143,  an  examination  of  the 
relevant  literature  reveals  that  only  a  very  few  proposed 
decision  models  have  found  favor  with  R&D  managers.  This 
was  first  noted  in  1957  [14:1533  and  since  that  time,  there 
has  been  a  continuous  creation  of  new  methods  and  tech¬ 
niques.  However,  the  utilization  factor  for  these 
methodologies  still  remains  extremely  low  C24;  159;  190; 
2333. 

Furthermore,  Baker  and  Freeland  [23:11653  identify  the 
inherent  limitations  of  these  R&D  decision  models  which  adds 
to  the  low  utilization  rates.  Each  model  exhibits  to  one 
degree  or  another  these  various  limitations: 

1.  Inadequate  treatment  of  risk  and  uncertainty. 

2.  Inadequate  treatment  of  multiple,  often  inter¬ 
related,  criteria. 

3.  Inadequate  treatment  of  project  interrelation¬ 
ships,  with  respect  both  to  value  contribution  and 
to  resource  utilization. 

4.  No  explicit  recognition  and  incorporation  of 
the  experience  and  knowledge  of  the  R&D  manager. 

5.  The  inability  to  recognize  and  treat  nonmone¬ 
tary  aspects  such  as  establishing  and  maintaining 
balance  in  the  R&D  program  (i.e.,  balance  between 
basic  and  applied  work,  between  offensive  and 


defensive  activity,  between  product  and  process 
effort,  between  in-house  and  contracted  projects, 
between  improvement  and  breakthrough  orientation, 
and  between  high  risk-high  payoff  and  moderate  or 
low  risk  moderate  payoff  opportunities). 

6.  Perceptions  held  by  the  R&D  managers  that  the 
models  are  unnecessarily  difficult  to  understand 
and  use. 

7.  Inadequate  treatment  of  the  time  variant  prop¬ 
erty  of  data  and  criteria  and  the  associated  prob¬ 
lem  of  consistency  in  the  research  program  and  the 
research  staff. 

Despite  these  limitations  there  exist  hundreds  of 
various  decision  models  C2373  that  have  been  applied  to  the 
R&D  portfolio  selection  problem.  Several  excellent  survey 
articles  have  appeared  in  the  literature  that  categorize  and 
describe  the  many  R&D  project  selection  methods  C22;  23;  24; 
49;  97;  127;  128;  182;  183;  232;  2373.  Also,  several  case 
studies  can  be  found  in  the  literature  that  describe  actual 
applications  of  various  techniques  C13;  38;  57;  60;  71;  83; 
135;  171;  208;  209;  224;  2843.  In  fact,  there  are  so  many 
different  models  available  that  Souder  1237:633  had  this  to 
say  about  the  situation: 

It  does  not  appear  that  a  confusing  plethora 
of  models,  with  little  basis  for  a  manager  to 
choose  among  them,  exists  in  other  management 
science  areas  to  the  degree  that  it  does  in  the 
area  of  R&D  investment  planning  models. 

Not  only  is  there  a  plethora  of  models  but  also  several 
different  ways  to  categorize  these  models  122:168;  23:1165; 
220:25-1323.  In  this  discussion  we  adopt  the  taxonomy  of 
models  proposed  by  Shepherd  C2203.  Basically,  there  exist 


at  least  four  general  literature  areas  that  explore  problems 


in  RScD  portfolio  selection  or  similar  problems.  These 
categories  are  capital  budgeting,  capital  rationing,  project 
selection,  and  multiple  criteria  optimization. 

Along  these  same  lines,  the  literature  can  be  divided 
into  two  additional  categories:  single  criterion  approaches 
and  multiple  criteria  approaches.  These  can  be  -further 
broken  down  into  those  that  deal  with  certainty  and  those 
that  attempt  to  account  -for  uncertainty.  One  -further  break¬ 
down  o-f  model  types  are  those  that  attempt  to  select  the 
■‘best"  alternative  from  a  set  of  alternatives  and  those  that 
are  aimed  at  choosing  a  "best  set"  of  al ternati ves.  Ac¬ 
cording  to  Shepherd  C220:25D  all  of  these  categories  lead  to 
a  natural  hierarchical  taxonomy  of  decision  models  (Figure 
2-1)  aimed  at  choosing  among  alternatives. 
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Figure  2-1.  Hierarchical  Taxonomy  of  R&D  Decision  Models 

Decision  models  that  attempt  to  select  a  single  "best” 


alternative  under  conditions  of  certainty  are  the  payback 


method,  average  rate  o-f  return,  internal  rate  of  return, 
profitability  index,  and  net  present  value.  These  models 
are  concerned  with  one  (usually  economic)  criterion  for 
selecting  the  best  alternative  when  possible  outcomes  are 
known  with  certainty.  The  above  models  are  often  called 
capital  budgeting  under  certainty  or  project  selection  under 
certainty.  Clark  C563  describes  a  profitability  project 
selection  method.  A  return  on  investment  approach  is 
presented  by  Augood  C19].  If  used  at  all  in  the  R&D 
portfolio  selection  problem,  these  economic  methods  are 
usually  applied  to  product-ori ented  research  C 142: 21]. 
However,  none  of  these  models  are  suitable  for  the  space 
technology  advocacy  problem  primarily  because  they  ignore 
the  pervasive  uncertainty  in  the  RStD  decision  situation. 
Their  practical  application  is  limited  by  the  need  for 
accurate  input  data  (usually  in  dollars),  and  the  fact  that 
they  cannot  be  used  to  analyze  projects  at  different  funding 
levels.  More  sophisticated  models  must  deal  with  these 
multiple  funding  levels. 

Models  that  deal  with  multiple  alternative  selection 
under  conditions  of  certainty  are  0-1  integer  programming, 
dynamic  programming  and  quadratic  integer  or  nonlinear 
programming.  These  models  are  called  capital  rationing  if 
budgetary  constraints  are  imposed  on  the  formulation.  Some 
of  the  models  in  this  category  allow  for  interdependent 
projects  or  alternatives.  However,  these  models  deal  with 
optimizing  against  a  single  criterion  and  are  inadequate  for 


dealing  with  uncertain  decision  situations.  Again,  a  rela¬ 
tively  large  amount  of  information,  usually  expressed  in 
dollars,  is  required  for  problem  formulations.  Also,  the 
expected  benefits  from  each  R&D  project  must  be  quantified 
in  such  a  way  as  to  be  consistent  with  the  objective  func¬ 
tion.  Along  this  same  line,  the  resources  required  by  each 
project  must  be  carefully  defined,  as  well  as  the  limits  to 
these  resources.  Examples  of  0-1  integer  programming  models 
can  be  found  in  [58;  81;  97;  153;  157;  1763.  Dynamic  pro¬ 
gramming  models  are  explored  in  [14;  34;  35;  97;  106;  128; 
138;  188;  2733.  Nonlinear  models  are  described  in  [543. 

The  next  general  category  of  decision  models  are  those 
that  deal  with  uncertainty  and  attempt  to  optimize  against  a 
single  criterion.  Examples  of  these  types  of  models  are 
simulation  [76;  156;  158;  175;  236;  2503;  portfolio  analysis 
C219;  2363;  network  models  [76;  156;  1863;  risk  analysis 
[69;  102;  118;  192;  2733;  chance  constrained  programming 
[97;  1283;  mean  variance;  and  mean  semi -variance  models. 
Within  the  military  R&D  environment  simulation  models 
include  TRACE  and  VERT  [15;  25;  37;  107;  150;  1733  as  well 
as  PROMAP  V  [843  and  PREDICT  2000  [1493.  Again,  none  of 
these  models  adequately  deals  with  the  uncertainty  in  the 
R&D  environment.  The  problem  lies  mainly  in  the  manner  in 
which  probability  distributions  are  generated  which  depends 
on  large  historical  databases  [107:69-70;  125:60-613. 

A  major  area  of  research  is  in  decision  models  that  can 
deal  with  multiple  criteria  under  conditions  of  uncertainty. 
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Models  in  this  category  are  scoring  models,  pro-file  reports, 
checklists,  goal  programming,  multi objective  optimization 
techniques,  dynamic  programming,  and  utility  models.  These 
models  show  the  greatest  promise  -for  evolving  into  decision 
models  that  can  adequately  address  the  complexities  within 
the  R&D  community.  For  example  Krawiec  E142:223  lists  -five 
advantages  of  scoring  methods. 

1.  Scoring  methods  are  specifically  designed  to 
incorporate  noneconomic  criteria. 

2.  Scoring  methods  use  input  data  in  the  form  of 
subjective  estimates  provided  by  knowledgeable 
people  as  well  as  in  the  form  of  point  or  interval 
statistical  estimates. 

3.  Scaring  methods  use  subjective  "guesses"  overt¬ 
ly  where  other  methods  generally  require  a  more 
costly  and  sophisticated  quantitative  form  of  the 
same  "guess. “ 

4.  The  subjective  probability  assessment  can  be 
built  into  the  conceptual  and  analytical  framework 
of  the  scaring  method  to  produce  an  efficient 
portfolio  of  R&D  projects. 

5.  The  scoring  methods  produce  results  that  are, 
on  average,  90  percent  rank-order  consistent  with 
economic  and  constrained  methods. 

In  general,  the  same  points  can  be  made  about  the  other 
methods  in  this  category.  Examples  of  scoring  methods  can 
be  found  in  Cl;  66;  73;  79;  89;  110;  134;  152;  172;  174; 
177;  223;  251;  276;  277;  278;  2823.  Profile  reports  are 
described  in  C85;  131;  2773.  Three  different  checklists  can 
be  found  in  Becker  C293.  Examples  of  applications  of  goal 
programming  are  found  in  C59;  124;  196;  226;  249;  2813. 
Theoretical  foundations  of  multiobjective  optimization  tech¬ 
niques  (MOOT)  as  well  as  other  mul ti cri teri a  decision  making 
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techniques  can  be  -found  in  Chankong  and  Haimes  [50;  513, 
Hirsch  C1173  and  Zeleny  E2883.  Examples  of  the  application 
o-f  MOOT  are  addressed  in  E3;  94;  98;  116;  165;  166;  222; 
281;  2893.  An  interesting  observation  about  these  MOOT 
applications  is  that  they  are  combined  with  a  utility  model 
for  eliciting  the  subjective  estimates  from  the  decision 
maker.  These  estimates  then  become  the  parameters  within 
the  multiobjective  problem  formulation. 

Although  many  other  methods  exist  such  as  fuzzy  set 
theory  E27;  30;  883,  stochastic  linear  programming  [553, 
factor  analysis  C2523,  and  discriminant  analysis  C263,  all 
share  the  same  set  of  limitations  discussed  earlier  [233. 
In  particular  all  are  dependent  on  subjective  judgments  for 
model  inputs.  We  now  discuss  two  alternative  methods  that 
are  specifically  designed  to  elicit  the  subjective  judgments 
of  the  decision  maker. 

Compar i son  of  MAUT  and  AHP 

The  two  methods  that  we  discuss  in  some  detail  are 
multiattribute  utility  theory  (MAUT)  [117;  137;  165;  214; 
215;  216;  2443  and  the  analytic  hierarchy  process  (A HP)  [2; 
119;  154;  155;  198;  199;  200;  201;  202;  203;  204;  205;  214; 
215;  261;  262;  263;  264;  265;  266;  2803.  MAUT  and  AHP  are 
designed  to  transform  noncommensurabl e  criteria  into  a 
personal  preference  scale  (also  known  as  a  utility  scale  or 
utiles)  [151:3303.  The  theoretical  foundations  for  MAUT  can 


be  found  in  the  excellent  text  by  Keeney  and  Raiffa  [1373. 


Those  interested  in  the  theoretical  development  of  AHP  are 
re-f erred  to  the  two  works  by  Eckenrode  [803  and  Saaty  [198; 
2033.  Eckenrode  discusses  various  ways  of  weighting  multi¬ 
ple  criteria  whereas  Saaty  develops  a  method  of  pairwise 
comparisons  (the  AHP)  to  weight  multiple  criteria. 

We  have  selected  AHP  as  the  methodology  for  eliciting 
the  subjective  preferences  and  judgments  of  the  experts.  To 
support  this  choice  we  feel  it  is  necessary  to  compare  the 
methodology  to  MAUT.  MAUT  is  well  supported  in  the  litera¬ 
ture  and  has  a  strong  theoretical  foundation.  It  has  also 
been  developed  into  highly  interactive  computer  programs 
C2443.  However,  from  our  own  personal  experience  with  using 
both  MAUT  and  AHP,  as  well  as  the  work  done  by  others,  the 
AHP  performs  better  according  to  the  following  criteria: 
ease  of  use,  ability  to  deal  with  both  quantifiable  and 
strictly  nonquantif iable  and  subjective  variables  at  the 
same  time,  ability  to  capture  preferences,  and  applicability 
to  group  decision-making  situations. 

Schoemaker  C2143  discusses  behavioral  issues  in  multi¬ 
attribute  utility  modeling  and  decision  analysis  and 
compares  AHP  and  MAUT.  Schoemaker  and  Waid  [215;  2673 
experimentally  compare  different  approaches  to  determining 
weights  in  additive  utility  models  of  which  MAUT  and  AHP  are 
two.  Gear,  Lockett  and  Muhlemann  [963  discuss  AHP  in  the 
context  of  group  problem  solving  and  highlight  the  advan¬ 
tages  of  the  AHP  over  MAUT.  The  results  of  these  compari¬ 
sons  and  experiments  clearly  show  that  AHP  performs  better 


than  MAUT  according  to  the  four  criteria  discussed  above. 
Gear,  Lockett,  and  Muhlemann  196:183  summarize  the  advan¬ 
tages  that  AHP  has  over  the  more  traditional  MAUT. 

1.  Instead  of  repeated  questioning  to  eradicate 
inconsistencies  in  a  mathematical  sense,  a  simple 
measure  of  consistency  is  calculated  and  presented 
to  the  decision  maker.  He  can  then  choose  to 
attempt  to  improve  his  consistency  or  continue 
with  a  degree  of  i nconsi stency. 

2.  The  -9  to  +9  ratio  scale  allows  fuzzy  variables 
to  be  easily  handled  together  with  more  closely 
defined  and  quantitative  variables. 

3.  The  algebraic  method  allows  the  calculation  of 
a  set  of  weights  in  spite  of  the  fact  that  the 
subjective  answers  imply  a  degree  of 
inconsistency. 

4.  The  method  naturally  lends  itself  to  self— use 
through  an  interactive  computer  package. 

5.  The  same  basic  method  may  find  application  in 
several  areas  related  to  the  RStD  portfolio  selec¬ 
tion  problem.  In  particular,  to  aid  the  calcula¬ 
tion  of  the  relative  overall  utility  of  project 
outputs,  and  to  generate  subjective  probability 
assignments  for  chance  intermediate  and  final 
outcomes  of  each  project. 

6.  The  method  is  very  suited  to  use  in  group 
decision-making  situations,  perhaps  combined  with 
some  form  of  Delphi  procedure  (or  nominal  group 
process) . 

To  summarize  to  this  point,  given  the  lack  of  consensus 
concerning  optimum  methods  for  solving  R8cD  portfolio 
selection  problems  and  the  varied  opinions  voiced  on  the 
validity  of  subjective  estimates,  it  appears  that  our 
research  effort  must  clearly  address  how  we  intend  to  deal 
with  subjective  inputs  and  how  best  to  minimize  the  effects 
of  biases  and  uncertainty.  We  do  this  by  developing  a 
decision  support  methodology  that  structures  the  decision 
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environment  hierarchically,  employs  the  analytic  hierarchy 
process  -for  the  elicitation  of  subjective  preferences,  and 
describes  the  data  and  information  requirements  for  sup¬ 
porting  the  decisions  of  the  space  technology  advocate.  The 
next  section  investigates  the  literature  dealing  with  deci¬ 
sion  support  and  how  it  can  be  used  in  R&D  portfolio 
selection. 


Decision  Support  Methodologies 

The  recent  trend  in  the  application  of  analytical 
techniques  to  the  R8tD  portfolio  selection  problem  appears  to 
be  away  from  decision  models  whereby  the  model  purparts  to 
give  the  "answer".  Instead,  the  trend  is  towards  the 
development  of  decision  information  systems  or  decision 
support  systems.  Baker  [22:1693  and  Baker  and  Freeland 
[23:11733  suggest  three  reasons  for  this  trend.  First,  the 
project  selection/resource  allocation  models  we  have  dis¬ 
cussed  above  do  not  include  all  the  important  and  relevant 
aspects  of  the  RStD  environment.  Second,  the  decision 
problem  is  usually  of  the  mul ticriteria  type  with  the 
typical  approach  to  quantifying  subjective  preferences  far 
from  satisfactory.  Finally,  the  R&D  process  is  highly 
uncertain  and  unpredictable.  Hence,  the  general  managerial 
attitude  to  the  normative  models  is  that  they  are  useful  for 
the  predictable  activities  but  are  totally  inadequate  for 
modeling  the  uncertainties  that  are  an  inherent  part  of  R&D. 
This  has  led  to  the  development  of  interactive,  decision 


information  or  decision  support,  scenario  generating 
approaches  that  offer  an  alternative  to  the  uncertainty  in 
the  R&D  decision  process. 

This  section  briefly  discusses  decision  support  in 
terms  of  it  being  a  distinctive  concept  and  methodology  for 
developing  computer-based  decision  aids  C136:viiil  and  the 
application  of  decision  support  to  the  RStD  project  selection 
problem.  In  Chapter  Six  Me  discuss  the  proposed  decision 
support  methodology  in  detail.  However,  the  general  philos¬ 
ophy  behind  decision  support  is  discussed  below  followed  by 
the  identification  of  the  various  elements  in  a  decision 
support  system. 

Decision  support  is  aimed  at  improving  the  decision 
process  with  computer  technology  being  the  focal  point. 
Keen  and  Morton  1136:11  identify  three  objectives  of  deci¬ 
sion  support.  First,  decision  support  is  provided  to  assist 
the  manager  in  the  decision  process  in  semi structured  tasks. 
Second,  decision  support  does  just  that;  it  supports,  rather 
than  replaces,  managerial  judgment.  Finally,  decision 
support  is  intended  to  improve  the  effectiveness  of 
decision  making  rather  than  its  efficiency.  In  the  context 
of  the  RStD  process  the  philosophy  of  decision  support  is 
that  the  manager  is  better  equipped  to  define  the  problem 
and  to  handle  the  uncertain  and  subjective  factors. 
According  to  Liberatore  and  Titus  1148:9731  the  attention 
should  be  towards  developing  techniques  that  assist  the 
decision-making  process  rather  than  attempting  to  optimize. 


These  techniques  that  assist  the  decision-making 
process  can  be  categorized  into  three  general  areas.  First, 
the  decision  support  system  must  provide  the  decision  maker 
with  access  to  the  appropriate  information,  usually  in  the 
form  of  a  database.  Second,  the  decision  maker  uses  this 
information  in  conjunction  with  one  or  more  analytical  tools 
in  order  to  gain  further  insight  into  his  decision  problem. 
The  analytical  tool  we  use  in  our  proposed  methodology  is 
the  AHP.  The  third  element  is  the  user  interface.  This  can 
be  the  most  critical  part  of  the  decision  support  system 
£16;  46;  52;  74;  101;  113;  136;  141;  145;  159;  184;  243; 
2453. 

The  remainder  of  this  thesis  is  directed  at  developing 
a  "user  friendly"  decision  support  methodology  for  space 
technology  advocacy  which  is  acceptable  to  management  and 
which  can  serve  as  a  useful  vehicle  for  studying  the  com¬ 
plexities  of  the  problem  from  a  management  viewpoint.  This 
methodology,  in  fact,  could  be  built  into  a  highly  interac¬ 
tive  decision  support  system  that  would  be  responsive  to  the 
needs  of  space  technology  planners. 


III. 


Introduction 

In  December  1979  Lieutenant  General  Richard  C.  Henry, 
Commander,  Space  Division,  Air  Force  Systems  Command, 
directed  a  framework  be  developed  from  which  to  advocate 
space  technology  issues.  In  1981  this  task  was  transferred 
to  the  Technology  Plans  Directorate  of  the  recently  organ¬ 
ized  Space  Technology  Center  (STC)  at  Albuquerque,  New  Mexi¬ 
co.  From  these  beginnings,  the  MSSTP  (Military  Space  Sys¬ 
tems  Technology  Plan)  evolved. 

The  MSSTP  was  intended  to  be  a  "reference  for  planning 
military  technology  programs. "  It  was  developed  to  catalog 
space  related  technology  information,  forecast  future 
threats  and  mission  requirements,  analyze  technology  needs 
for  the  future  by  identifying  technological  deficiencies, 
and  recommend  R?<D  programs  to  correct  these  shortfalls 
C170b:i— ID.  The  purpose  of  the  MSSTP  was  to  communicate  and 
focus  space  technology  needs  so  that  the  necessary  techno¬ 
logies  would  be  available  to  support  military  requirements 
of  the  future  C170a:iiD. 

The  first  edition  of  the  MSSTP  was  published  in  January 
1982.  Since  that  time  it  has  undergone  significant  changes 
in  direction,  scope,  and  content.  The  MSSTP  started  as  an 
ambitious  attempt  to  describe  a  methodology  for  "optimizing 
investment  of  space  resources"  E227D.  It  was  originally 


designed  to  quantitatively  derive  a  prioritized  list  of 


resource  constrained  technology  programs  through  an  algo¬ 
rithm  called  TRUMP  (Technology  Resource  Utility  Management 
Process) .  However,  as  of  this  writing,  the  major  emphasis 
of  the  MSSTP  has  shifted  from  prioritizing  specific  programs 
to  prioritizing  the  technology  issues  themselves.  In  the 
words  of  Lieutenant  Colonel  Pete  Soliz,  a  primary  mover  in 
developing  the  current  direction  and  scope  of  the  MSSTP,  the 
only  thing  that  can  be  said  with  any  certainty  concerning 
the  MSSTP  is  that  "it  is  a  dynamic  and  iterative  process’* 
C230] . 

Despite  these  changes,  the  MSSTP  today  represents  a 
significant  and  unique  contribution  to  space  R&D  advocacy. 
The  forty  man-year  effort  that  has  gone  into  the  MSSTP  thus 
far  has  resulted  in  a  fairly  comprehensive  and  continually 
growing  database  of  space  related  technologies.  This  data¬ 
base  is  particularly  useful  to  space  system  designers  and 
long-range  planners  when  considering  future  military 
requirements  that  can  potentially  be  met  by  space— based 
systems.  Technology  assessments  in  the  MSSTP  also  assist 
R&D  advocates  attempting  to  secure  funding  and  support  for 
various  technology  initiatives  with  potential  space 
appl ications. 

Since  our  methodology  (presented  in  succeeding 
chapters)  builds  upon  the  work  already  accomplished  in 
creating  the  MSSTP,  we  take  the  time  here  to  explain  the 
process  in  some  detail.  The  next  section  describes  the 
MSSTP  (as  published)  and  TRUMP.  This  then  provides  the 
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foundation  for  further  discussion  of  the  space  technology 


process.  Next,  we  discuss  STC’s  attempts  to  implement  MSSTP, 
which  serves  to  highlight  the  dynamics  of  the  process. 
Finally,  there  is  a  discussion  of  some  of  the  shortfalls  of 
both  early  MSSTP  efforts  and  TRUMP.  Throughout  this  discus¬ 
sion  we  focus  on  the  problems  with  quantitatively  modeling  a 
complex  process  of  this  sort  in  an  environment  of  uncertain¬ 
ty.  This  discussion  leads  to  our  proposed  methodology, 
which  is  an  alternative  approach  designed  to  better  cope 
with  the  uncertainty  and  subjectivity  of  space  technology 
advocacy. 

Overview  of  the  MSSTP  and  TRUMP 

The  ultimate  goal  of  space  technology  planning  is  to 
"ensure  that  an  adequate  technology  base  exists  to  support 
options  for  future  U.S.  military  space  systems"  C170b:4-ll. 
The  MSSTP  is  a  framework  from  which  to  analyze  RStD  require¬ 
ments,  determine  what  are  the  most  critical  technology 
issues,  and  finally  to  develop  a  plan  for  resolving  these 
issues. 

An  overview  of  the  six  volume  set  of  the  MSSTP  is 
presented  first.  The  emphasis  is  on  showing  how  the  process 
is  designed  to  flow  as  a  "network  of  interconnected  logical 
processes"  C170b:l-1D.  A  discussion  of  TRUMP  concludes  the 
section.  Even  though  TRUMP  is  no  longer  used  for  priori¬ 
tizing  technology  issues  or  programs,  we  believe  it 
demonstrates  some  of  the  problems  encountered  in  quantita- 


tive  analyses  o-f  problems  of  this  magnitude  and  complexity. 

The  discussion  is  synthesized  from  published  volumes  o-f 
the  MSSTP,  MSSTP  technology  panel  reports,  and  our  inter¬ 
views  with  STC  personnel  over  the  last  several  months. 
However,  as  previously  noted,  the  MSSTP  is  a  dynamic  process 
and  as  such  some  of  the  information  may  change  or  has 
changed  as  of  this  writing.  Interested  readers  should  refer 
directly  to  the  latest  edition  of  the  MSSTP  for  more  current 
and  detailed  information. 

The  MSSTP.  Figure  3—1,  extracted  from  the  MSSTP 
Executive  Summary  C170a:l— 2D,  depicts  the  process  described 
in  the  six  volume  set  that  is  the  MSSTP.  For  the  most  part, 
the  volumes  correspond  to  each  of  the  five  steps  shown. 
"Assess  Technology  Needs'*  incorporates  information  presented 
in  Volumes  III  and  IV,  while  “Prepare  Technology  Roadmaps" 
includes  both  Volumes  V  and  VI. 

We  give  considerable  weight  to  the  discussion  of  Volume 
I,  Mission  Rationale.  since  this  volume  establishes  the 
environmental  framework  within  which  the  MSSTP  process 
operates.  Remaining  volumes  are  addressed  in  less  detail. 

Volume  I.  "Mission  Rationale”.  The  opening  volume 
lays  the  groundwork  for  subsequent  volumes  by  discussing  the 
environment  in  which  space  technology  planning  takes  place. 
It  argues  that  space  technology  must  be  responsive  to 
national  policies,  international  agreements  and  laws,  and 
operational  military  requirements.  Its  primary  purpose  is 


to  identify  military  tasks  that  could  use  space  systems  to 


1.  ESTABLISH  BASIC  2.  ESTABLISH 

MISSIONS  (1985-20101  _ PROJECTED  NEEDS  I  THREATS 


TW«tATl_ 

firm 

v 

•  saouro 

•  CONTROL 

sjSSI 

^  “*■  ji^ 

.CAPACITY 

attuo*  moviot  tactical 

• auAirrr 

WAANIKG  Of  ATTACK 

•  TIHtUICS 

ON  NQffTM  AMI  NtCA 

•  AVAlLAtIUTY 

5.  PREPARE  TECHNOLOGY 
ROADMAPS 


4.  ASSESS 

TECHNOLOGY  NEEDS 


nuMsuotv 

RUM 

•  »ntn 

•  rrnicTunu 
»  ROW* 

•  WOWUlOR 

•  m. 


3.  PREPARE  PRELIMINARY 
SYSTEM  CONCEPTS 


Figure  3-1.  The  Space  Technology  Model  Process 

accomplish  military  missions  in  the  1985-2010  time-frame. 
Potential  space  system  concepts  can  then  be  linked  to  these 
military  tasks  to  demonstrate  how  they  could  support 
operational  requirements.  Tasks  selected  in  Volume  I  deter¬ 
mine  the  quantitative  performance  needs  for  system  concepts 
described  in  Volume  II.  Shown  in  Figure  3-2  E170a:I-2J  is  an 
overview  of  the  methodology  covered  in  Volume  IT 

Task  Derivation.  National  policies  and  in¬ 
ternational  laws  and  agreements  dealing  with  the  use  of 
space  constrain  what  tasks  can  be  performed  in  space.  Air 


Force  doctrinal  statements  discuss  the  specific  restrictions 
concerning  use  and  deployment  of  certain  military  systems  in 
space  and  specify  military  space  responsibilities  and 


Figure  3-2.  MSSTP  Volume  I  Methodology 


missions  that  are  bounded  by  these  restrictions.  Essential¬ 
ly,  doctrine  specifies  military  responsibilities  in  space. 
These  responsibilities  then  identify  tasks  which  can  be 
accomplished  to  support  military  missions  in  space.  Ulti¬ 
mately,  these  tasks  are  constrained  by  existing  policies, 
international  agreements  and  laws,  and  doctrine. 

Despite  these  constraints,  Volume  I  cites  the  impor¬ 
tance  of  flexibility  in  selecting  tasks.  Constraints  can  be 
dynamic  and  usually  change  as  national  interests  evolve. 
"It  is  a  major  function  of  the  technology  base  to  support  a 


wide  range  of  potential  decisions  concerning  national  inter¬ 


est  and  policy"  C170b:2-13.  Additionally,  the  technology 
base  must  provide  a  hedge  against  technological  surprise  and 
support  future  expansion  of  military  operations  into  space 
C170b:2-143.  Volume  I  further  suggests  that  analyzing  U.S. 
capabilities  and  projected  Soviet  threats  is  a  way  to  iden¬ 
tify  future  operational  requirements. 

First,  the  threat  is  analyzed  with  respect  to  current 
and  projected  Soviet  capabilities  in  space.  Volume  I  summa¬ 
rizes  the  Soviet  threat  in  space,  deriving  information  from 
a  number  of  intelligence  estimates  and  threat  documents 
Cl 70b: 3-23.  The  general  findings  are  that  the  Soviet  threat 
is  severe  in  terms  of  quantity,  quality,  and  kinds  of  sys¬ 
tems  employed  by  the  USSR.  The  Soviets  have  made  extensive 
use  of  space  and  have  developed  a  quick  reaction  capability 
and  flexibility  in  the  employment  of  their  systems.  Esti¬ 
mates  concerning  these  specific  projected  Soviet  capabili¬ 
ties  are  then  detailed. 

Next,  formal  operational  needs  statements  submitted  by 
various  commands  and  operational  users  are  considered. 
Statements  of  Operational  Need  (SONs) ,  Mission  Element  Needs 
Statements  (MENS),  and  Required  Operational  Capability 
statements  (ROCs)  were  reviewed  to  determine  future  space 
capabilities  needed  to  support  missions  and  tasks  covered  in 
these  statements.  Tasks  listed  r»r  implied  in  these  sources 
were  extrapolated  to  include  future,  long-term  needs. 

Finally,  taxing  the  above  factors  into  consideration, 
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Space  Division  analysts  consulted  the  Air  Force  Planning 
Guide.  which  evaluates  a  large  number  of  military  tasks. 
Tasks  are  evaluated  on  the  basis  o-f  current  military  capa¬ 
bility  and  importance  o-f  the  task  to  determine  a  priority 
•for  each  task.  Twenty-six  candidate  tasks  that  are  poten¬ 
tially  accomplished  or  supported  by  space-based  systems  were 
selected  from  this  list  of  tasks  C170b:4-33.  The  complete 
task  lists  are  provided  in  Appendix  A. 

It  should  be  pointed  out  that  there  are  some  inconsis¬ 
tencies  in  task  descriptions.  Some  represent  desired 
objectives  ("ballistic  missile  accuracy  enhancement"), 
others  are  missions  and/or  functions.  Me  asked  STC 
personnel  to  explain  in  greater  detail  how  tasks  were 
derived,  and  some  of  the  problems  encountered  during  the 
process.  Me  learned  that  when  Space  Division  analysts 
developed  the  list  of  tasks,  they  found  they  had  a  "mixed 
bag"  with  tasks  overlapping  mission  linkages  in  the  mission 
hierarchy.  They  found  it  difficult  to  establish  clear 
delineation  between  tasks,  in  part  due  to  the  "large  area  of 
uncertainty",  the  fact  that  task  derivation  was  an  "immature 
area",  and  the  "lack  of  doctrinal  consensus"  with  respect  to 
space  as  an  environment  where  military  operations  could  be 
conducted  11443.  Mhile  STC  personnel  recognize  the  draw¬ 
backs  with  overlaps  among  tasks  and  between  tasks,  missions, 
and  functions,  they  feel  they  have  to  work  with  what  they 
currently  have  available.  Lieutenant  Colonel  Dave  Lange 
C 1441 , 


who  played  a  key  role  in  developing  Volumes  I  and  II 


of  the  MSSTP  stated: 

The  Air  Staff,  in  the  context  of  mission  area 
analysis,  will  have  to  increasingly  address  the 
space  arena  as  military  dependency  upon,  and  use 
of  space  continues  to  evolve  in  the  future,  but  in 
the  meantime  we  will  work  around  the  problem. 

Evaluation  of  Tasks  Against  Missions.  The 
next  step  in  the  Volume  I  methodology  is  to  link  the  26 
tasks  to  DOD  mission  areas.  The  purpose  is  to  show  coverage 
of  all  possible  triservice  missions  by  linking  tasks  to 
missions  and  mission  areas.  Volume  I  uses  a  reference 
developed  by  the  Under  Secretary  of  Defense  for  Research  and 
Engineering  issued  on  19  June  1981  (“Research,  Development, 
and  Acquisition  Mission  Areas  and  Mission  Area  Descrip¬ 
tions")  that  provides  a  comprehensive  breakdown  of  DOD 
mission  areas  and  program  elements.  Tasks  are  sorted 
according  to  mission  areas  and  categories.  Some  mission 
areas  are  covered  by  more  than  one  task,  while  others  have 
no  corresponding  space  related  tasks  assigned  to  them 
C 170b: 4-1 13. 

TRUMP  used  this  data  to  show  connectivity  between 
tasks,  missions,  mission  areas  and  arenas  to  derive  task  and 
ultimately  concept  priorities.  Task  and  mission  area  link¬ 
ages  to  the  26  space  tasks  are  listed  in  Appendix  B. 

Linkage  of  Military  Functions  to  Tasks.  Next 
a  set  of  military  functions  which  apply  to  the  task  list  is 
derived.  Military  functions  are  defined  in  the  MSSTP  as 
generic  actions  or  "groups  of  generic  actions  which,  when 


combined,  meet  the  objective  of  military  tasks"  C170a: 1-123. 


These  functions  represent  "building  blocks"  that  allow  tasks 
to  be  broken  down  and  considered  in  terms  of  smaller  units, 
which  can  ultimately  be  quantitatively  measured.  Six 
separate  functions  are  selected  which  apply  to  the  space 
task  list.  These  are:  surveillance,  communications,  naviga¬ 
tion,  environmental  monitoring,  force  applications,  and 
space  operations.  Survei 1 lance,  force  applications,  and 
space  operations  are  further  broken  down,  resulting  in  a 
list  of  15  functional  building  blocks  which  define  tasks 
(see  Appendix  C) .  The  MSSTP  adds  the  qualifier  that  this 
list  of  functions  is  not  comprehensi ve  due  to  the  "total 
number  involved  and  because  the  selection  will  vary  with  the 
perspective  of  the  individual"  compiling  the  list  C170a:I- 
123. 

Each  task  is  evaluated  with  respect  to  the  15  func¬ 
tions,  and  functions  (those  required  to  define  the  task 
performance  and  capability)  are  assigned  to  tasks.  For 
example,  the  task  "warning  of  ballistic  missile  attack  on 
CONUS"  has  three  functions  associated  with  it:  ballistic 
missile  detection  and  track,  space  vehicle  detection  and 
track  (both  sub-categories  under  the  functional  heading  of 
surveillance),  and  communications.  Functions  are  described 
in  sufficient  detail  to  drive  out  performance  needs  for  the 
task.  For  example,  the  function  "ballistic  missile  detec¬ 
tion  and  track"  is  defined  as  "detect  the  launch,  track  and 
identify  all  ballistic  missile  flights"  C170b:5-33. 


Derivation  o-f  Performance  Parameters.  Final¬ 
ly,  performance  parameters  are  derived  -for  each  o-f  the 
f unction-task  pairs  to  provide  quantitative  measures,  which 
then  define  performance  requirements  to  accomplish  the 
tasks.  Six  measures  of  performance  are  cited  in  Volume  I  to 
assist  analysts  in  quantitatively  describing  functional 
requirements  imposed  by  the  tasks.  These  are  C170b: 4-191: 

Coverage:  Geographical  boundaries  over  which  the 
functions  must  be  performed. 

Capacity:  The  number  of  units  served,  detected, 
identified,  tracked,  etc.  The  number  of  messages, 
units,  or  bits  transmitted  or  received  per  second. 

Quality:  Quantitative  measures  of  the  distin¬ 
guishing  attributes  such  as  location  accuracy, 
probability  of  detection,  false  alarm  rate,  proba¬ 
bility  of  correct  message  receipt,  track  accuracy, 
probability  of  kill,  etc. 

Timeliness:  Allowable  system  time  delays  or  re¬ 
sponse  times  such  as  allowable  time  from  event 
detection  to  message  transmission  of  event 
detection. 

Availability:  Percentage  of  time  the  system  must 
be  in  position  and  able  to  accomplish  the  assigned 
task. 

Survi vabi 1 i ty:  Endurance  requirements  imposed  by 
the  military  mission  or  task.  Specified  in  terms 
of  duration  (minutes,  hours,  days,  years)  a  func¬ 
tion  must  be  available  to  accomplish  the 
associated  task. 

Each  function-task  pair  is  evaluated  with  respect  to 
these  performance  parameters  in  conjunction  with  six  levels 
of  the  conflict  spectrum:  peace,  crisis,  theater  non¬ 
nuclear  war,  theater  nuclear  war,  central  nuclear  phase,  and 
central  reconstitution  phase.  Matrices  are  developed  that 
show  conflict  levels  as  columns  and  performance  measures  as 
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rows,  allowing  for  36  discrete  inputs  for  performance 
requirements  C 170b: 4-201. 

These  measures  are  intended  to  quantify  the  specific 
performance  requirements  of  each  function  as  they  relate  to 
the  list  of  military  tasks  that  can  be  performed  in  space. 
If  tasks  are  sufficiently  described  to  define  specific  func¬ 
tional  requirements,  then  performance  parameters  can  be 
defined  which  then  provide  these  quantitative  measures.  The 
quantitative  measures  in  turn  can  describe  the  levels  of 
technology  required  to  ultimately  perform  the  tasks.  It  is 
significant  to  note  that  performance  parameters  have  not 
been  specified  for  many  of  the  function-task  pairs  addressed 
i n  Vol ume  I . 

Summary  of  Volume  I.  The  methodology  de¬ 
scribed  in  Volume  I  is  designed  to  identify  performance 
needs  for  system  concepts.  First,  tasks  pertaining  to  mili¬ 
tary  requirements  that  can  potentially  be  accomplished  in 
space  are  derived  from  various  sources.  Space  Division 
analysts  review  current  guidance  relating  to  military  appli¬ 
cations  in  space  as  expressed  in  policy  and  doctrine.  They 
also  consider  U.S.  capabilities,  projected  threats,  and 
future  operational  requirements  as  defined  in  various  needs 
statements  prepared  by  operational  users.  Twenty-six  possi¬ 
ble  tasks  that  can  be  accomplished  in  space  are  derived. 

Next,  these  tasks  are  evaluated  against  a  comprehensive 


mission  list  to  validate  their  adequacy  in  terms  of  covering 
all  space  related  mission  requirements  of  the  three 


•r.  rz  s 


■:  T,  \r_ 


services.  Then,  -fifteen  military  -functions  that  can  be 
performed  in  space  are  derived  and  analyzed  to  determine 
which  ones  apply  to  the  twenty— six  tasks.  These  functions 
are  "building  blocks"  and  serve  to  quanti tati vely  describe 
specific  task  requirements.  Finally,  each  function  is 
analyzed  in  terms  of  six  performance  parameters  which  iden¬ 
tify  quantifiable  needs  imposed  by  the  related  tasks. 

These  needs  are  the  basic  output  of  Volume  1  and  can  be 
used  to  determine  the  capabilities  space  systems  must  have. 
In  fact,  these  performance  needs  become  the  basic  building 
blocks  for  the  system  designer  when  devising  space— based 
concepts  that  can  perform  military  tasks  in  space  C 170b: 6- 
11. 

Volume  II.  “System  Concept  Options".  Vol ume  I I 
describes  several  system  concepts  that  can  be  linked  to  the 
military  tasks  and  performance  needs  addressed  in  Volume  I. 
The  early  version  of  the  MSSTP  states  that  these  concepts 
"are  fabricated  on  the  basis  of  the  performance  needs  of 
Volume  I"  and  may  address  a  single  function  of  a  particular 
task  or  meet  performance  needs  of  a  function  that  is  appli¬ 
cable  to  several  tasks.  Alternatively,  a  system  designer  may 
devise  several  designs  that  perform  the  same  function  for  a 
specific  task  to  determine  technology  needs  for  these  com¬ 
peting  options  C170b:6-1 3.  The  interface  that  is  intended 
to  exist  between  Volumes  I  and  II  is  depicted  in  figure  3-3 
Cl 70b: 6-23. 
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Figure  3-3.  Vol  I  -  Vol  II  Interface 

The  original  Volume  II  listed  34  system  concept 
candidates.  Updates  and  changes  in  direction  have  changed 
this  list  considerably.  Concepts  are  separated  into  three 
categories:  near-term,  far -term,  and  SDI  (Strategic  Defense 
Initiatives).  Near-term  concepts  are  11  concepts  rank- 
ordered  by  the  Space  Systems  Architecture  Study  Group  (SSA) 
in  early  1984.  They  considered  many  of  the  original  34 
concepts  and  others,  and  applied  resource  constraints  in 
selecting  the  top  concepts  based  on  importance  and  IOC  dates 
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(those  with  early  IOC  dates  usually  were  considered  higher 


priority  than  longer  termed  concepts).  The  second  group, 
•far-term  concepts,  includes  those  concepts  not  rank-ordered 
by  the  SSA,  as  well  as  concepts  generated  by  STC,  the  Aero¬ 
space  Corporation,  and  AIAA  technology  panels.  These  later 
concepts  addressed  known  or  projected  deficiencies  not  cov¬ 
ered  by  the  SSA  concept  list.  For  example,  heavy  lift 
launch  vehicle  and  orbital  transfer  vehicle  concepts  were 
included  to  provide  a  capability  to  lift  the  more  massive 
payloads  required  by  some  of  the  SSA  and  SDI  concepts  into 
final  orbits.  SDI  concepts  are  those  concepts  that  directly 
relate  to  the  Strategic  Defense  Initiatives  recommended  by 
the  Fletcher  Committee  and  alluded  to  during  President  Rea¬ 
gan's  now  famous  ballistic  missile  defense  ("Star  Wars”) 
speech  C47;  2533. 

The  intent  of  Volume  II  is  to  identify  advances  in 
technology  required  to  make  possible  improved  military  space 
systems  for  the  future.  Concepts  in  Volume  II  are  described 
in  detail  and  include  the  technologies  needed  to  build  them. 
Projected  IDC  dates  are  associated  with  each  concept.  The 
assumption  is  made  that  required  technologies  must  be  avail¬ 
able  at  least  five  years  prior  to  the  concept  IOC  date  to 
ensure  low-risk  engineering  development  of  the  technologies. 
More  than  one  concept  may  relate  to  the  same  military  func- 
tion/perf ormance  need,  but  will  vary  in  terms  of  perform¬ 
ance,  risk,  availability  date,  or  technology  requirements. 


Concepts  are  linked  to  the  military  tasks  identified  in 


Volume  I  C 170a: I 1-51 .  Appendix  D  shows  this  linkage. 


Originally,  Volume  II  showed  technology  issue  impacts 
on  concept  realization,  where  a  technology  issue  represents 
a  shortfall  in  performance  that  could  not  be  met  by  existing 
or  projected  technological  advances.  These  assessments  were 
made  by  concept  originators  or  long-range  planners,  who  were 
often  unaware  of  or  qualified  to  make  these  assessments. 
Future  editions  of  the  MSSTP  will  list  technology  issues  as 
an  appendix  to  Volume  II  C1443. 

Concepts  are  not  intended  to  be  point  designs  for 
development.  Instead,  they  represent  a  range  of  systems 
which  could  be  developed  by  the  year  2000  and  are  intended 
as  "strawman"  concepts  to  cover  the  “spectrum  of  anticipated 
future  mission  needs,  to  indicate  levels  of  performance  that 
are  desirable  and  possible,  and  to  serve  as  a  basis  for  the 
planning  of  future  developments  in  technology"  C170c: 11-13. 
Concepts  in  Volume  II  provide  the  forum  to  identify  technol¬ 
ogy  issues  that  must  be  resolved  in  order  to  build  the 
concepts  or  provide  the  capabilities  called  for  by  the 
concepts. 

Volume  III,  "Technology  Trends  and  Forecasts. 
Volume  III  is  actually  a  two  volume  set  that  represents  an 
extensive  compilation  of  the  current  and  forecasted  state- 
of-the-art  (SOA)  of  technologies  required  to  support  the 
space  systems  discussed  in  Volume  II.  The  primary  objective 
of  Volume  III  is  to  present  useful  data  for  forecasting 
technologies  relevant  to  future  military  systems  in  space 


C170a:  III-3D.  Appendix  E  lists  several  of  these  technolo¬ 
gies  by  technology  discipline. 

Within  each  technology  discipline,  specific  information 
relating  to  current  technology  status,  programs  already 
underway  or  conceived  (funded  and  unfunded)  to  advance  the 
SOA  of  the  technology,  and  forecasts  for  potential  break¬ 
throughs  or  upper  bounds  on  the  technology  are  documented. 
Where  possible,  figures  of  merit  are  defined  and  character¬ 
istics  are  described  for  each  technology  area.  For  example, 
under  "Telescopes  and  Optics,"  performance  figures  of  merit 
include:  resolution,  modulation  transfer  function,  optical 
transmission  over  passband,  out  of  field  rejection,  RMS 
wavefront  quality,  and  energy  on  a  detector  element.  Among 
the  characteristics  described  for  telescopes  and  optics  are: 
focal  length,  field  of  view,  aperture,  spectral  bandpass, 
weight,  and  temperature  tolerance  I170d:1013.  Figures  of 
merit  are  used  to  plot  SOA  and  projected  SOA  against  time  to 
forecast  technology  trends.  Known  technology  programs  that 
are  on— going  or  planned  are  also  plotted  to  represent  spe¬ 
cific  technology  goals. 

The  output  of  Volume  III  is  a  forecast  of  the  probable 
status  of  technology  issues  in  the  future.  Many  of  the 
programs  cited  in  Volume  III  are  unfunded.  The  result  is 
that  many  technology  issues  may  go  unresolved  unless  crit¬ 
ical  efforts  are  planned,  funded,  and  initiated  promptly. 

Volume  IV.  "Technology  Assessments".  In  Volume  II 


technology  requirements  are  identified  for  each  concept  and 


then  compared  with  technology  trends  and  forecasts  discussed 
in  Volume  III  to  arrive  at  the  assessments  detailed  in 
Volume  IV.  A  shortfall  between  the  projected  technology 
available  five  years  prior  to  a  concept’s  IOC  date  and  the 
required  performance  capability  of  the  concept  defines  a 
technology  issue.  Technology  issues  exist  when  forecast 
technological  advances  are  insufficient  to  provide  the 
needed  performance  required  by  the  concept. 

Volume  IV  identifies  technology  issues  based  on  the 
analysis  described  above  and  then  summarizes  the  status  of 
concepts  with  respect  to  the  number  and  level  of  technology 
issues  associated  with  each  one.  As  you  might  expect,  most 
of  the  concepts  listed  have  at  least  some  suspected  techno¬ 
logical  deficiencies  (gaps  between  projected  SOA  and 
performance  required). 

Signif icantly.  Volume  IV  does  not  address  systems  trade 
studies,  intertechnology  trade-offs,  or  detailed  design 
studies  that  potentially  eliminate  some  of  the  technology 
issues  C170e:iiil.  Instead,  Volume  IV  identifies  those 
issues  that  appear  most  critical  in  ensuring  the  success  of 
the  concepts  addressed  in  Volume  II.  Trade-offs  and  de¬ 
tailed  design  studies  are  the  responsibility  of  the  system 
designer.  The  MSSTP  provides  the  information  base  to  assist 
him  in  better  defining  the  technology  efforts  required  for 
development  of  a  system. 

Volume  IV  concludes  with  a  list  of  "high-payoff"  tech¬ 
nologies  which  represent  a  qualitative  assessment  of 


potentially  critical  technology  issues.  These  technologies 
were  subjectively  identified  by  “implication,  indication, 
and  identification  of  technology  gaps  or  deficits  ('pro¬ 
jected  to  be  available’)  or  by  knowledge  of  apparent,  but 
not  indicated  technology  problems"  C170e:1891.  Appendix  F 
provides  a  partial  list  of  these  high-payoff  technologies. 

Volume  V.  "Technology  Plans".  Since  we  were 
unable  to  review  a  copy  of  the  published  or  current  draft 
version  of  Volume  V,  our  comments  are  based  on  the  overview 
included  in  the  Executive  Summary  and  our  recent  discussions 
with  STC  personnel.  Part  of  the  reason  for  this  incomplete 
review  is  that  Volume  V,  as  well  as  Volume  VI,  have  gone 
through  numerous  iterations  and  changes.  As  discussed  in 
the  Executive  Summary  to  the  MSSTP,  Volume  V  should  present 
an  unconstrained  set  of  technology  plans  organized  under  the 
various  technology  disciplines  introduced  in  Volume  III. 
Technology  programs  would  be  conceived  and  documented  to 
resolve  the  technology  issues  identified  in  Volume  IV. 
Under  each  technology  discipline  the  following  information 
was  to  be  included:  a  hierarchy  of  performance  parameters 
for  the  technology;  ongoing  programs  which  lead  toward 
attainment  of  these  parameters;  probabilities  of  success  for 
each  technology  program,  expressed  as  risk  functions  of  time 
and  funding;  and  logical  extensions  of  the  programs  to 
resolve  technology  issues  not  specifically  addressed  by 
existing  programs  C 170a: IV-31 .  Also  to  be  documented  were 


the  cost  and  schedule  information  for  each  technology 


program  and  i  dent  i-fi  cat  ion  of  participating  organizations. 

Based  on  our  discussions,  it  appears  that  the  current 
emphasis  will  be  on  technology  issues  as  opposed  to  planning 
specific  technology  programs  to  resolve  those  issues. 
Responsibility  for  developing  the  detailed  R&D  programs  will 
remain  with  the  appropriate  laboratories  C229;  2301. 

Volume  VI.  "Technology  Program”.  As  we  indicated 
in  the  introduction,  Volume  VI  was  to  present  the  resource 
constrained  technology  plan.  Technology  programs  discussed 
in  Volume  V  were  to  be  prioritized  according  to  the  technol¬ 
ogy  issue  weights  with  which  they  were  associated.  The 
weighting  of  technology  issues  was  to  be  a  function  of  the 
concept  priority  to  which  the  technology  issue  was  linked, 
the  frequency  of  the  technology  issue  (linkage  to  more  than 
one  concept  or  function-task  pair),  the  relative  weightings 
of  missions  supported  by  concepts,  and  other  variables  such 
as  cost,  timing,  and  availability.  The  priori tization 
process  would  identify  a  list  of  high  priority  technology 
programs  constrained  by  available  resources  C170a:lV-9; 
2281. 

Since  the  publication  of  the  Executive  Summary.  Volume 
VI  has  gone  through  numerous  iterations.  For  the  near  term, 
it  appears  that  the  published  version  of  Volume  VI  will  be 
limited  to  a  condensed  prioritized  list  of  technology  issues 
related  to  the  three  groupings  of  concepts  discussed  earlier 
(SSA,  far— term,  and  SDI  concepts).  This  listing  probably 


will  not  reflect  resource  constraints  C2301. 


The  next 


section  describes  TRUMP,  the  resource  allocation  model 
designed  to  make  use  of  the  information  in  the  MSSTP. 

TRUMP  (Technology  Resource  Utility  Management  Process). 
As  we  indicated  in  the  introduction,  TRUMP  was  a  set  of 
decision  rules  that  was  to  use  information  from  the  MSSTP 
database  and  provide  the  STC  with  an  "optimum"  technology 
investment  plan.  It  was  a  logical,  straightf orward  method¬ 
ology  that  failed  to  gain  acceptance  the  first  time  it  was 
applied  to  a  real  world  situation  C2283.  To  understand  why 
it  was  abandoned  as  the  method  of  choice  for  prioritizing 
technology  programs  and  concepts,  it  is  first  necessary  to 
understand  how  the  process  was  designed  to  operate  and  the 
data  requirements.  The  following  discussion  is  based  on 
interviews  with  Mr.  Tim  Spinney,  the  primary  developer  of 
TRUMP  C2423,  and  Lieutenant  Colonel  Pete  Soliz  E2281. 

TRUMP  Data  Base  Structure  and  Algorithm.  First  of 
all,  TRUMP  was  a  combination  of  several  entities.  It  de¬ 
pended  on  a  hierarchical ly  structured  database  and  used  an 
intelligent  operating  system,  consisting  of  fairly  user 
friendly  commands,  to  sort  and  search  through  the  database. 
It  incorporated  several  "pre-processing"  steps  designed  to 
further  sort  concepts  and/or  technology  programs  according 
to  specified  criteria.  Finally,  it  included  some  simple 
mathematical  algorithms  designed  to  optimize  technology 
programs  and  concepts  on  the  basis  of  frequency,  concept 
importance,  risk,  and  cost  (budget  constraints). 


The  TRUMP  database  was  organized  as  shown  in  Figure  3-4 


C242D.  Inputs  for  “area",  arena  ,  "mission1*,  and  mission 
requirements"  came  -from  Volume  I.  Note  that  “missions" 
correspond  to  the  26  tasks  and  "mission  requirements"  to  the 
15  military  -functions  derived  in  Volume  I.  Concepts  were 
input  from  Volume  II,  technology  issues  -from  Volume  IV,  and 
technology  programs  -from  Volume  V. 

Areas  and  arenas  were  weighted  by  relative  importance 
according  to  mission  area  analyses  performed  by  the  Air 
Sta-f-f  (recall  tasks  were  prioritized  in  the  Air  Force 
Planning  Guide).  Areas  and  arenas  directly  corresponded  to 
the  DoD  mission  headings  developed  by  the  Under  Secretary  of 
Defense  for  Research  and  Engineering  and  used  to  relate 
military  tasks  to  missions  in  Volume  I  of  the  MSSTP.  Areas 
were  either  Strategic  or  Tactical  Warfare,  and  arenas  repre¬ 
sented  broad  divisions  of  responsibility  under  areas.  For 
example,  "offense"  and  "defense"  were  arenas  under  Strategic 
Warfare,  while  "air",  "land",  and  "sea"  represented  arenas 
under  Tactical  Warfare. 

Weightings  were  "normalized"  so  that  total  weights 
horizontally  (across  the  levels  under  a  single  higher  ele¬ 
ment)  summed  to  1.0.  In  other  words,  if  there  were  two 
areas  (strategic  and  tactical),  the  sum  of  their  weights  had 
to  equal  1.0.  These  weights  were  defined  as  the  "utility" 
of  the  given  area  or  arena.  Task  ("mission")  priorities 
were  obtained  by  multiplying  the  weights  of  the  "arena"  and 


"areas'*  to  which  they  were  linked. 

TRUMP  used  the  utilities  derived  by  the  Air  Staff  for 


Figure  3-4.  TRUMP  Database  Organization 
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“missions"  to  determine  weights  for  "military  requirements  , 
"concepts",  and  "technology  programs".  Functions  ("military 
requirements”)  were  prioritized  by  considering  the  number  of 
times  a  particular  function  appeared  under  a  given  area 
(through  linkage  with  “missions")  and  then  multiplying  this 
integer  value  times  the  weight  of  the  "missions"  associated 
with  this  arena.  The  total  utility  of  a  function  was  found 
by  summing  these  products  for  every  applicable  arena.  For 
example,  if  communications  (one  of  the  15  functions 
identified  in  Volume  I)  supported  3  missions  under  arena  A 
(with  utility  =  0.36)  and  2  missions  under  arena  B  (with 
utility  =  0.42)  and  no  others,  then  the  total  utility  for 
communications  would  be:  (3) (.36)  +  (2) (.42)  —  1.92. 

Concepts  supporting  the  "mission  requirements"  were 
similarly  prioritized.  The  utility  of  a  concept  supporting 
a  single  mission  requirement  was  simply  the  utility  of  the 
associated  mission  requirement.  The  utility  of  a  concept 
supporting  more  than  one  mission  requirement  was  a  function 
of  the  frequency  and  the  relative  weights  of  the  mission 
requirements  under  which  it  appeared.  Utility  values  for 
concepts  were  derived  as  described  above  for  mission  re¬ 
quirements.  TRUMP  then  applied  budgetary  constraints  to  the 
concepts,  and  output  two  sets  —  a  prioritized  funded  con¬ 
cept  list  and  a  prioritized  unfunded  concept  list. 

Utilities  for  technology  issues  and  technology  programs 
were  similarly  calculated.  A  technology  issue  was  defined 
in  TRUMP  by  the  set  of  technology  programs  that  related  to 


an  unresolved  technology  problem  that  prevented  development 
of  the  associated  concept  using  known  or  projected  SOA 
technology.  Neither  technology  issues  nor  technology  pro¬ 
grams  were  necessarily  "collectively  exhaustive"  or  "mutual¬ 
ly  exclusive."  In  other  words,  the  technology  issues  linked 
to  a  concept  did  not  necessarily  represent  all  technology 
issues  whose  successful  resolution  was  necessary  to  build 
the  concept.  Others  may  exist  that  are  undefined  or  un¬ 
known.  Likewise,  resolution  of  one  technology  issue  may 
resolve  all  or  part  of  another  technology  issue  related  to 
the  concept. 

The  same  can  be  said  of  technology  programs.  Addition¬ 
ally,  technology  programs  could  be  subordinate  to  one 
another.  For  example,  the  success  of  a  technology  program 
could  depend  on  the  success  of  one  or  more  subordinate 
programs. 

Technology  program  data  requirements  included:  the  name 
of  the  program,  its  priority,  schedule,  cost,  confidence  (a 
subjective  estimate  of  the  probability  of  success),  and 
position  (is  it  subordinate  to  other  programs) .  This  infor¬ 
mation  was  extracted  from  Volume  V  of  the  MSSTP.  Data 
relating  cost,  schedule,  and  risk  (1  -  confidence)  were 
maintained  in  the  database  on  each  technology  program  in  a  3 
x  3  matrix  format.  Each  technology  program  matrix  had  nine 
input  values.  The  center  point,  called  the  nominal  value, 
was  set  at  0.8  and  represented  the  confidence  level  (esti¬ 
mated  probability  of  success)  of  completing  the  particular 
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program  at  a  set  -funding  and  schedule  level.  The  remaining 
eight  paints  were  reserved  far  con-fidence  values  -for  various 
combinations  o-f  schedule  and  cost.  Schedule  (time)  was 
plotted  on  the  ordinate,  with  intervals  of  +  20%.  Likewise, 
cost  was  plotted  along  the  abscissa,  with  the  left  side 
representing  a  20%  reduction  in  budget  and  the  right  side  a 
20%  increase.  For  example,  the  top  lefthand  corner  of  each 
technology  program  matrix  would  show  the  estimated  confi¬ 
dence  that  a  particular  technology  program  would  succeed  if 
the  budget  were  cut  20%  and  the  schedule  reduced  by  20%. 

So  far  we  have  discussed  how  TRUMP  prioritized  con¬ 
cepts,  technology  issues,  and  technology  programs.  We  saw 
how  the  database  included  quantitative  information  on  each 
technology  program  relating  to  cost,  schedule,  risk  (as  a 
function  of  the  probability  of  success  or  confidence),  and 
the  number  of  subordinate  programs.  Additionally,  Volume  II 
of  the  MSSTP  provided  concept  IOC  dates,  which  in  turn 
define  technology  required  availability  dates  (five  years 
prior  to  IOC) .  These  data  are  used  by  TRUMP  in  several 
preprocessing  steps  to  generate  an  "optimal"  prioritized 
technology  program  list  subject  to  budgetary  constraints  by 
matching  rel ated  technology  programs  to  the  prioritized 
concept  lists  (funded  and  unfunded)  previously  discussed. 

Given  an  acceptable  risk  level  for  technology  programs 
and  a  budget  limitation  provided  by  higher  headquarters, 
TRUMP  would  first  process  technology  programs  associated 
with  the  top  priority  concept.  If  all  technology  programs 


could  be  accomplished  by  the  projected  IOC  date  of  the 
concept  at  or  above  an  acceptable  risk  level,  the  technology 
program  with  the  least  cost  was  selected  to  support  that 
particular  concept  (by  resolving  the  technology  issue  the 
program  was  linked  to).  Otherwise,  the  algorithm  identified 
the  concept  as  supportable  (can  be  accomplished  by  IOC  date 
but  at  an  unacceptable  risk)  or  as  late  (none  o-f  the  tech¬ 
nology  programs  can  be  completed  in  time  to  meet  the  concept 
IOC  date,  regardless  o-f  risk  or  cost).  Technology  programs 
were  then  matched  to  the  respective  concepts  they  supported, 
according  to  concept  priority.  This  procedure  continued 
until  budget  constraints  were  satisfied. 

Problems  With  TRUMP.  TRUMP  was  abandoned  as  the 
methodology  for  prioritizing  technology  programs  when  the 
Space  Systems  Architecture  Study  Group  attempted  to  use  it 
to  prioritize  concepts  earlier  this  year.  Group  members 
were  not  satisfied  with  the  prioritized  list  generated  by 
TRUMP.  A  major  reason  for  their  dissatisfaction  with  the 
technique  was  that  group  members  did  not  fully  understand 
the  process  and  had  no  part  in  determining  utilities  of 
mission  requi rements.  Their  major  consideration  was  pro¬ 
jected  IOC  dates  of  concepts,  and  they  ultimately  priori¬ 
tized  concepts  primarily  on  the  basis  of  IDCs  (those  with 
the  earliest  IOCs  generally  received  high  priorities)  12281. 

TRUMP  had  other  problems  as  well,  many  due  to  the  fact 
that  it  represented  a  first  attemp  at  a  quantitative  ap¬ 
proach  to  optimizing  a  prioritized  list  of  technology  pro- 


grams.  Some  of  these  problems  are  discussed  below. 

Recall  that  confidence  levels  were  assigned  to  each 
technology  program  as  a  function  of  time  and  funding  (the 
nominal  value  being  0.8).  Technology  programs  could  be 
subordinate  to  other  technology  programs.  If  TRUMP  found 
one  technology  program  dependent  on  the  success  of  more  than 
one  other  technology  program,  the  value  for  the  lowest 
estimated  probability  of  success  was  assigned  to  the  top 
program.  Accepted  probability  theory  dictates  that  if  an 
event  is  dependent  on  more  than  one  other  event  occurring, 
then  its  probability  of  occurring  is  the  product  of  the 
probabilities  of  all  other  events  it  is  dependent  upon.  The 
following  example  illustrates  the  point. 

Assume  a  technology  program  is  dependent  upon  the 
success  of  two  other  programs  (A  &  B) ,  as  shown  in  Figure  3- 
5.  Furthermore,  assume  technology  program  A  can  be  resolved 
by  either  technology  program  A1  or  A2,  while  technology 
program  B  depends  upon  successful  completion  of  both  subor¬ 
dinate  programs  B1  and  B2.  Finally,  assume  all  programs  are 
at  their  nominal  values  (probability  of  success  is  0.8). 
TRUMP  would  show  that  the  final  probability  of  success  or 
confidence  of  the  technology  program  is  0.8  (the  lowest  of 
any  of  the  subordinate  programs).  Application  of  probabil¬ 
ity  theory  would  show  d:  ferent  results,  with  the 
probability  of  success  of  the  top  program  dependent  on  the 
success  of  subordinate  programs  A  and  B.  The  probability  of 
success  for  program  A  is  0.96  C 1- (0. 2) (0. 2) 3 ,  while  the 
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Figure  3—5.  Derivation  of  Probability  of  Success 


probability  o-f  success  -for  program  B  is  0.64  t  (0. 8)  (0. 8)  3 . 
Since  the  top  program  depends  upon  both  A  and  B  being 
successful ,  its  probability  o-f  success  is  the  product  o-f  the 
probabilities  o-f  A  and  B,  or  (0.96)  (0.64)  =  0.6144, 
signi-f icantly  less  than  the  TRUMP  value  of  0.8! 

Another  problem  is  the  manner  in  which  probabilities 
are  elicited.  Laboratory  personnel  and  AIAA  technology 
panel  members  were  asked  to  estimate  the  amount  of  funding 
and  time  necessary  to  ensure  a  confidence  level  of  0.8  (the 
nominal  value)  for  each  technology  program.  Then  they  were 
asked  to  estimate  probabi 1 i ti es  for  the  other  eight  elements 
of  the  3x3  matrix  to  determine  confidences  if  funding  and 
time  were  reduced  or  increased  in  2 07.  increments.  These 
estimates  were  made  on  the  basis  of  "best  guesses”  with 
little  or  no  known  information.  In  one  lab,  methods  for 
estimating  these  values  varied  from  time  consuming  discus¬ 
sions  with  other  experts  to  obtain  consensus  to  lab 
personnel  quickly  filling  in  the  matrix  values  and  "gaming” 
the  system  (i.e.. 


reflecting  extremely  low  values  for  fun- 


ding  and  time  reductions  and  slightly  higher  probabi 1 i ties 
than  the  nominal  value  -for  increased  -funding  and  schedule) 
C1223. 


We  have  already  painted  out  in  Chapter  Two  the  inherent 
problems  with  making  subjective  estimates  in  an  environment 
of  uncertainty  when  we  discussed  eliciting  subjective  proba¬ 
bilities.  Furthermore,  we  believe  data  provided  on  the 
probabilities  for  the  +  2 0%  increments  of  time  and  funding 
to  be  unrealistic,  considering  the  variance  in  methods  used 
to  solicit  data  and  the  large  amount  of  uncertainty.  For 
example,  Rowe  and  Somers  point  out  that  in  a  survey  of  47 
major  programs,  interim  estimates  averaged  218%  over  initial 
estimates  [192:19].  These  figures  indicate  that  attempting 
to  estimate  probabilities  for  increments  of  +  2 0%,  when  the 
initial  estimates  for  costs  and  funding  are  likely  to  be  off 
by  better  than  200%,  will  not  provide  meaningful  information 
and  should  not  be  used  as  inputs  in  a  quantitative  model. 

The  points  made  above  highlight  one  of  the  major  de¬ 
tractors  of  TRUMP.  Despite  the  fact  that  it  incorporated 
subjective  probabi 1 i ti es,  the  final  output  for  all  intents 
and  purposes  could  be  interpreted  as  deterministic.  The 
methodology  was  designed  to  provide  a  prioritized  list  of 
technology  issues  subject  to  budgetary  and  time  constraints. 
If  funding  the  least  expensive  technology  program  of  several 
possible  candidates  would  satisfy  a  given  technology  issue 
(assuming  risk  and  time  constraints  were  met),  then  only 
that  program  was  selected.  Recall  that  TRUMP  worked  to 


satisfy  technology  issues  relating  to  concepts  (i.e.  resolve 
all  technology  issues  related  to  the  top  priority  concept 
first,  assuming  time  and  risk  constraints  could  be  met). 
Consider  the  following  example. 

Assume  all  technology  issues  associated  with  a  top 
priority  concept  could  be  resolved  by  single  programs  at 
nominal  levels  (PCSuccessD=0. 8) .  Further,  assume  risk 
levels  were  at  or  below  0.2  (1-PCSuccessI)  and  that  time 
constraints  (technology  issues  resolved  five  years  prior  to 
concept  IOC  date)  were  met.  The  TRUMP  methodology  would 
conclude  that  all  technology  issues  related  to  that  concept 
could  be  resolved  at  a  cost  that  equalled  the  summation  of 
the  costs  for  the  technology  programs  selected,  with  a 
probability  of  success  of  0.8.  We  have  already  pointed  out 
that  TRUMP  ignored  the  dependency  axioms  of  probability 
theory.  In  fact,  the  probability  of  success  for  resolving 
all  technology  issues  associated  with  a  given  concept  would 
equal  the  product  of  the  probabilities  of  success  for  each 
technology  issue,  a  significantly  smaller  value  than  0.8. 

Furthermore,  the  literature  supports  the  premise  that 
success  in  R&D  is  maximized  by  the  number  of  independent 
programs  undertaken  to  resolve  a  particular  technology 
problem.  For  example,  Peters  and  Waterman  C18SI  point  out 
that  parallel  projects  are  crucial  to  the  success  of  an  R&D 
effort.  They  cite  an  IBM  executive  who  stated  that  in  every 
maior  successful  development  project  "there  were  two  or 
three  (about  five  once)  other  small  projects,  ...  (comprised 


of)  f our-to-six-person  groups,  ...  who  had  been  working  on 


parallel  technology  or  parallel  development  efforts" 
£185:2053.  Many  other  authors  similarly  conclude  that  an 
organization’s  chances  of  successfully  resolving  technology 
problems  are  improved  by,  among  other  things,  maximizing  the 
number  of  independent  and  parallel  efforts  C2J ;  26;  41;  100; 
101;  179;  187;  240;  2413. 

Along  the  same  lines,  the  literature  (and  many  of  the 
people  we  interviewed)  conclude  that  most  RStD  efforts  never 
deliver  as  promised.  In  most  cases,  success  is  measured  by 
some  percentage  of  the  originally  stated  performance  objec¬ 
tives  for  the  research  effort.  For  example,  one  STC 
technologist  related  that  during  the  time  he  worked  with  the 
Advanced  Manned  Spacecraft  Concept,  most  of  the  contracted 
research  and  development  efforts  resulted  in  some  reduced 
performance  capability  than  the  initially  contracted  for 
performance.  He  further  stated  that  parallel  efforts,  when 
they  could  be  afforded,  usually  provided  system  designers 
with  enough  technology  tradeoffs  to  provide  the  required 
capability  C1323.  Other  authors  also  support  the  premise 
that  combining  the  results  of  parallel  RScD  efforts  often 
provide  the  necessary  performance  required,  where  no  single 
project  could  C41;  185;  1873. 

In  summary,  TRUMP  was  an  attempt  to  solve  the  difficult 
problem  of  quantitatively  optimizing  a  resource  constrained 
list  of  technology  programs.  Through  sophisticated  algo¬ 
rithms  and  sort  techniques  it  took  subjective  data  and 
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output  lists  of  funded  and  unfunded  technology  programs  that 
would  resolve  technology  issues  crucial  to  the  success  of 
concepts.  We  described  some  of  the  problems  with  TRUMP. 
These  included  a  decision  methodology  that  did  not  allow  for 
inputs  from  the  decision  maker  (weighting  of  concepts,  tech¬ 
nology  issues).  Also,  TRUMP  treated  highly  subjective  (and 
uncertain)  data  in  a  deterministic  manner.  Moreover,  this 
discussion  pointed  out  some  of  the  considerable  difficulties 
in  attempting  to  quantify  R&D  advocacy,  which  must  operate 
in  an  environment  of  great  uncertainty.  The  next  section 
addresses  how  STC  has  attempted  to  prioritize  technology 
issues  in  the  absence  of  a  quantitative  model  like  TRUMP. 

STC  Implementation  of  MSSTP 

With  the  abandonment  of  TRUMP,  the  Space  Technology 
Center  had  no  methodology  for  prioritizing  technology 
issues.  Faced  with  compressed  suspenses  to  publish  Volume 
VI,  the  prioritized  technology  issue  list,  STC  developed  a 
qualitative  methodology  for  rank  ordering  technology  issues 
in  terms  of  their  relative  importance  to  concept  realiza¬ 
tion.  We  had  the  opportunity  to  observe  application  of  the 
process  while  on  a  visit  to  STC  in  June  1984.  Comments  made 
in  this  section  are,  for  the  most  part,  based  on  our 
personal  observations  and  subsequent  discussions  with  STC 
personnel . 


The  technique  adopted  by  the  STC  was  designed  to  prior¬ 
itize  technology  issues  as  they  related  to  the  three  groups 


of  concepts  previously  described  in  our  discussion  of  the 
MSSTP  —  SSA  (near -term) ,  far-term,  and  SDI  concepts.  SSA 
concepts  were  prioritized  with  respect  to  each  other  based 
on  an  ordinal  scale.  That  is,  concepts  were  ranked  with 
respect  to  the  other  concepts  in  the  SSA  group,  but  the 
differences  between  the  numbers  had  only  relative  and  not 
absolute  meaning.  The  far-term  concepts  were  ranked  using 
SSA  mission  weights  derived  through  mission  area  analysis. 
SDI  concepts  were  not  ranked. 

Technology  issues  under  each  concept  were  weighted  with 
respect  to  their  importance  to  the  concept  using  what  was 
intended  to  be  an  interval  scale  from  1  to  5.  The  highest 
weight  ("5")  was  to  be  assigned  to  those  technology  issues 
that  were  enabling,  i.e.  the  concept  could  not  be  built 
without  resolving  the  technology  issue.  The  lowest  weight 
("1”)  was  reserved  for  those  technology  issues  which  were 
only  beneficial  to  the  concept  (resolution  of  the  technology 
issue  may  contribute  to  the  performance  capability  of  the 
concept,  but  was  not  crucial  to  its  success).  Integer 
values  between  5  and  1  were  assigned  to  technology  issues 
based  on  the  following  criteria:  "5",  representing  a  tech¬ 
nology  issue  which  would  cause  a  concept  degradation  of  80 
to  100%;  "4*',  60  to  8 07.  degradation;  "S",  40  to  60%  degrada¬ 
tion;  "2",  20  to  40%  degradation;  and  finally,  "1",  0  to  20% 
degradation.  We  note  here  that  there  was  no  intent  to  rank- 
order  technology  issues  within  a  given  concept  (if  all 
technology  issues  were  considered  enabling  to  the  concept. 


then  all  could  potentially  receive  the  highest  weighting  of 
"5"). 

After  each  technology  issue  was  weighted  within  each  of 
the  concepts,  then  the  ranking  of  the  concept  (where  appli¬ 
cable)  and  the  frequency  of  occurrence  of  the  same  technol¬ 
ogy  issue  appeared  with  respect  to  the  concepts  were  consid¬ 
ered.  Various  algorithms  were  suggested  to  ultimately  pri¬ 
oritize  technology  issues  within  each  of  the  three  groups  of 
concepts,  taking  the  above  three  factors  into  account.  As 
of  this  writing,  none  of  the  methods  have  been  accepted. 
For  the  most  part,  this  is  because  the  methods  suggested 
thusfar  have  mixed  ordinal  and  cardinal  numbers  in  mathemat¬ 
ical  operations  C2313.  For  example,  one  method  multiplied 
the  concept  weight  (an  ordinal  number)  with  the  technology 
issue  weight  (intended  to  be  a  cardinal  number)  and  the 
frequency  (a  cardinal  number)  to  determine  the  overall 
weight  of  the  technology  issue  with  respect  to  other  tech¬ 
nology  issues  within  the  SSA  concept  grouping.  Recall  that 
ordinal  rankings  do  not  reflect  absolute  values  between  each 
of  the  ranked  elements.  For  this  mathematical  operation  to 
make  any  sense,  the  ranking  between  concepts  must  be  based 
on  an  interval  scale  as  a  minimum,  which  would  provide  the 
information  "how  much  more  important  is  one  concept  with 
respect  to  another." 

Despite  the  fact  that  an  accepted  methodology  for  jus¬ 
tifying  a  final  prioritized  technology  issue  list  has  not 
yet  been  found,  understanding  the  process  used  by  the  STC  to 


weight  the  various  technology  issues  is  useful.  A  group  of 
technologists,  representing  various  technology  disciplines, 
was  formed  to  evaluate  technology  issues  as  they  related  to 
a  list  of  28  concepts.  Concept  packages  were  provided  each 
group  member,  where  each  package  contained  the  concept  title 
and  the  technology  issues  related  to  it.  Technology  issues 
were  organized  under  each  of  the  17  technology  disciplines 
addressed  in  Volume  III  of  the  MSSTP. 

Group  members  devoted  one  hour  to  each  of  the  concepts. 
An  expert  familiar  with  the  concept  had  15  minutes  to  brief 
the  group  on  the  concept  description  and  an  additional  15 
minutes  to  describe  the  technology  issues  associated  with 
that  concept.  Another  15  minute  period  was  dedicated  for 
discussion  of  the  technology  issues,  where  group  members 
could  query  the  briefer  for  information  about  the  concept  or 
the  associated  technology  issues.  Finally,  15  minutes  was 
reserved  for  group  members  to  vote  on  the  technology  issues, 
assigning  each  issue  a  value  from  1  to  5  based  on  the  impor¬ 
tance  of  the  technology  issue  to  the  concept.  Except  for 
the  "interval"  scale  description  provided  earlier,  there 
were  no  other  attributes  defined  for  this  scale. 

The  ultimate  abjective  of  the  process  was  to  surface 
enabling  technologies  ("5"  rankings)  associated  with  the 
concepts.  Group  members  considered  points  made  during  the 
concept  discussion  and  their  own  expertise  in  ranking  tech¬ 
nology  issues  as  "high"  (5),  "medium"  (3),  or  "low"  (1), 
with  the  integers  2  and  4  reserved  for  in-between  ratings. 
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Individual  voting  results  were  tabulated  and  averaged  with 
the  results  -from  other  group  members  to  arrive  at  average 
weights  assigned  each  of  the  technology  issues.  Then  these 
average  weights  were  considered  with  respect  to  concept 
priority  and  frequency  to  determine  an  overall  prioritized 
technology  issue  list  for  each  of  the  concept  groupings. 

We  were  present  for  two  and  a  half  days  of  the  voting 
process.  During  this  time  we  had  the  opportunity  to  observe 
the  group  interaction  and  the  questions  and  concerns  group 
members  raised  about  the  process  and  the  information 
briefed.  These  observations  and  the  tentative  conclusions 
we  drew  from  them  are  discussed  in  the  next  several  para¬ 
graphs.  They  are  pertinent  to  this  thesis  effort  since  they 
helped  identify  for  us  valid  concerns  that  must  be  addressed 
in  any  methodology  which  qualitatively  describes  attributes 
used  as  performance  measures  to  rank  order  elements. 

The  discussion  below  is  by  no  means  complete.  However, 
we  attempted  to  filter  the  important  factors  that  seemed  to 
have  had  the  greatest  impact  on  the  ranking  process.  They 
also  add  background  information  for  the  discussion  that 
follows  in  the  next  section. 

First  of  all,  concept  packages  were  sometimes  inaccu¬ 
rate  or  incomplete.  For  example,  the  same  technology  issues 
sometimes  were  duplicated  under  different  technology  disci¬ 
plines  for  a  given  concept.  This  confusion  among  voting 
members  had  to  be  resolved  during  the  one  hour  time  period 
reserved  for  discussion  of  the  concept.  Concept  briefings 


varied  in  completeness.  Some  were  more  detailed  than  oth¬ 
ers.  In  some  cases,  briefers  assigned  -for  particular  con¬ 
cepts  were  not  -fully  knowledgeable  of  all  the  details  or 
objectives  of  the  concept.  In  other  cases,  too  many  tech¬ 
nology  issues  were  identified  for  a  given  concept  to  be 
adequately  addressed  in  the  one  hour  time  frame  allotted. 
At  least  four  (that  we  know  of)  concepts  had  over  125  tech¬ 
nology  issues  related  to  each  one.  These  factors  can  only 
adversely  influence  the  identification  and  ranking  of  crit¬ 
ical  technology  issues  associated  with  particular  concepts. 

Another  problem  was  that  there  did  not  appear  to  be  a 
consistent  definition  for  "technology  issues"  among  group 
members.  Recall  that  the  MSSTP  defined  a  technology  issue 
as  the  difference  between  the  projected  technology  SOA  five 
years  prior  to  the  IOC  of  a  given  concept  and  the  capability 
required  by  the  concept.  However,  some  considered  a  tech¬ 
nology  issue  to  be  any  technology  capability  required  to 
build  the  concept,  whether  the  technology  was  projected 
state-of-the-art  or  not.  Others  felt  that  one  technology 
issue  should  be  selected  among  those  potentially  able  to 
resolve  similar  deficiencies.  For  example,  man-in-space 
issues  were  dropped  in  some  cases  because  group  members  felt 
autonomy  technology  issues  would  resolve  the  on-orbit  main¬ 
tenance,  operations,  and  station-keeping  technology  issues. 
The  confusion  caused  by  the  inconsistency  in  definitions 
resulted  in  group  members  making  trade-offs  between  technol¬ 
ogies,  prioritizing  issues  that  did  not  fit  the  MSSTP  defi- 


nition  o-f  a  technology  issue,  and  deleting  some  technology 
issues  -from  consideration.  These  problems  could  be  recti¬ 
fied  by  ensuring  group  members  understood  and  accepted  the 
working  definition  of  technology  issues  before  applying  the 
process. 

We  also  observed  that  the  concept  to  technology  linkage 
did  not  necessarily  identify  all  pertinent  technology 
issues.  The  purpose  of  the  concepts,  as  stated  in  the 
MSSTP,  was  to  identify  technology  issues  related  to  build¬ 
ing  space  systems  in  the  future.  They  were  not  intended  to 
be  "point  designs."  Nonetheless,  we  found  that  group  mem¬ 
bers  seemed  to  focus  on  concepts  as  point  designs.  They 
traded-off  technologies  against  each  other  (as  we  pointed 
out  in  the  man-in-space  vs.  autonomy  example);  deleted  some 
technology  issues;  or  failed  to  add  others  that  potentially 
supported  concept  deployment,  employment,  or  sustainability. 
Additionally,  group  members  often  questioned  the  extent  to 
which  concepts  supported  the  military  tasks  to  which  they 
were  linked.  As  we  mentioned  in  the  last  section,  this 
information  is  not  available  in  the  MSSTP. 

Finally,  various  biases  surfaced  during  the  process. 
As  we  mentioned  earlier,  the  level  of  expertise  among 
briefers  varied,  as  did  presentation  formats,  styles,  and 
detail  of  information  presented.  Furthermore,  while  the 
group  composition  was  appropriate  for  prioritizing  technol¬ 
ogy  issues  within  concepts,  it  did  require  the  experts  to 
evaluate  technology  issues  outside  of  their  areas  of  exper- 
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tise.  Group  members  were  particularly  dependent  on  the 
brie-fer  and  his  presentation  for  pertinent  information.  As 
discussed  by  Hogarth  and  Makridakis  [1201,  individual  and 
group  biases  can  adversely  affect  these  processes. 

On  the  other  hand,  if  all  technology  issues  had  been 
grouped  by  discipline,  and  criteria  identified  to  prioritize 
issues  within  disciplinary  areas,  then  technology  experts 
having  the  expertise  in  the  particular  discipline  could  be 
selected  to  prioritize  these  issues.  This  procedure  would 
have  eliminated  trade-offs  occuring  between  technologies, 
the  deletion  of  certain  technology  issues,  and  the 
uncertainty  felt  by  some  group  members  when  evaluating  tech¬ 
nologies  with  which  they  were  unfamiliar.  It  certainly 
would  not  eliminate  all  biases,  but  it  would  limit  the 
number  of  different  biases  and  facilitate  identifying  the 
presence  and  effect  of  other  biases  [120;  531. 

Up  to  this  point  we  have  presented  an  overview  of  the 
MSSTP  process  by  describing  the  methodology  and  various 
attempts  to  apply  the  methodology.  The  MSSTP  has  signifi¬ 
cantly  contributed  to  the  body  of  knowledge  by  providing  a 
comprehensive  database  of  space-related  R&D  efforts  and 
requirements.  Air  Force  organizations  and  the  aerospace 
industry  have  found  this  information  useful  when  considering 


or  presenting  design 

proposals  [2301. 

However , 

the  MSSTP 

has  limitations 

in 

its  methodology. 

Many  of 

these 

are 

simply  due  to 

the 

dynamic  nature  of 

the  process  and 

the 

environment  in 

which  it  operates.  In 

the  next 

section 

we 

analyze  the  MSSTP  process  and  summarize  its  major  limitations 


Analysis  of  the  MSSTP 

In  our  discussion  o-f  the  MSSTP  Me  learned  that  one  of 
its  objectives  was  to  identi-fy  space  technology  issues  that 
support  space  system  architecture  options  over  the  next  two 
to  three  decades.  The  technology  plan  was  to  be  derived 
through  quantitative  analysis.  Information  available  in  the 
MSSTP  database  was  manipulated  within  a  mission  area 
analysis  framework  to  identify  an  "optimum"  list  of  priori¬ 
tized  technology  programs.  Using  information  previously 
presented  as  background,  we  analyze  the  MSSTP* s  utility  as  a 
methodology  for  technology  planning  to  provide  the  broad 
technology  base  to  support  the  space  system  architecture  of 
the  future. 

Utility  of  Quantitative  Approaches  to  the  RStD  Advocacy 
Problem.  We  have  shown  that  the  MSSTP  process  is  heavily 
dependent  on  subjective  data.  Technology  issues  are  priori¬ 
tized  using  qualitative  attributes  and  linkages  to  concepts. 
Performance  parameters  are  designed  to  be  quantitative  goals 
for  concepts,  and  yet  are  qualitatively  derived  by  pro¬ 
jecting  threats  and  future  required  capabilities.  Specific 
data  describing  technology  issues  and  programs  discussed  in 
Volume  V  of  the  MSSTP  are  similarly  derived.  Estimates  for 
costs,  timeframes,  and  program  risks  are  "best  guesses" 
provided  by  laboratories  and  AIAA  panels.  All  of  these  data 
are  generated  in  an  environment  of  uncertainty  and  yet  the 


thrust  o-f  the  MSSTP  is  to  use  these  subjective  data  as 
"deterministic"  or  "point  estimate"  values  in  de-fining  a 
-final  space  technology  plan. 

We  painted  out  in  Chapter  Two  the  uncertainty  inherent 
in  the  R&D  process.  The  process  is  subject  to  unforeseen 
changes  in  funding,  policies,  and  leadersnin  support,  which 
themselves  are  influenced  by  a  variety  of  other  external 
factors.  Each  R&D  program  is  unique.  No  realistic  method 
exists  for  applying  experience  or  historical  data  from 
previous  R&D  programs  to  predict  trends  or  forecasts  for 
xuture  R&D  efforts.  Most  other  management  science  applica¬ 
tions  (inventory  control ,  transportation  algorithms, 

1 inear /stochastic  programming,  etc.)  either  are  determin¬ 
istic  (all  input  values  are  known  with  certainty)  or  proba¬ 
bilistic  (input  values  can  be  predicted  on  the  basis  of 
known  probability  functions  for  input  parameters).  R&D 
portfolio  selection  models  on  the  other  hand  must  rely  on 
uncertain  data,  where  even  the  probability  functions  of 
input  parameters  are  unknown. 

We  also  discussed  how  most  quantitative  decision  models 
dealing  with  R&D  portfolio  selection  problems  attempted  to 
deal  with  these  uncertainties.  Data  were  solicited  from 
knowledgeable  personnel  (in  the  form  of  subjective  probabil¬ 
ities)  and  used  as  inputs  to  probabilistic  or  deterministic 
models  to  output  "optimal"  decisions.  We  pointed  out  that 
subjective  probabilities  are  subject  to  numerous  biases  and 
tend  to  be  highly  inaccurate  in  forecasting  future  outcomes 


(costs,  time-frames,  or  probabilities  o-f  success  -for  given 
programs) .  The  impact  o-f  biases  and  uncertainty  are  magni¬ 
fied  with  the  complexity  of  the  problem.  When  inputs  depend 
on  numerous  organizations  with  differing  perceptions,  goals, 
and  values,  the  validity  of  the  data  as  point  estimates  is 
even  more  suspect. 

Recall  from  our  discussion  of  Volume  I  of  the  MSSTP 
that  these  factors  played  a  significant  role  in  deriving 
tasks  and  performance  parameters.  Additionally,  qualitative 
attributes  assigned  to  other  MSSTP  parameters  are  also 
questionable.  For  example,  the  MSSTP  assigned  qualitative 
attributes  to  timeframe  (near-term,  mid-term,  and  far -term) , 
risk  (low,  moderate,  and  high),  and  effectiveness  (highly 
and  moderately).  We  queried  STC  experts  on  the  validity  of 
these  attributes,  since  we  were  exploring  the  feasibility  of 
using  these  values  as  inputs  ourselves  to  develop  a  quanti¬ 
tative  approach  to  the  problem.  We  learned  that  STC  has 
very  little  confidence  in  even  the  qualitative  descriptions 
assigned  to  these  parameters. 

Reasons  for  this  lack  of  confidence  varied,  but  most  of 
the  difficulties  stem  from  the  fact  that  inputs  for  these 
parameters  were  provided  by  several  different  organizations, 
representing  various  interests  and  possessing  different 
goals,  values,  and  interests.  For  example,  the  attributes 
for  timeframe  implied  different  target  dates  to  different 
organizations.  Laboratories  and  industry  considered  "far- 
term"  to  mean  "after  the  year  2000,"  which  reflected  their 


RScD  orientation  (RScD  efforts  normally  take  years  or  decades 


to  complete) .  On  the  other  hand,  SPOs  (System  Program 
Offices)  work  with  actual  systems  (requiring  RScD  to  upgrade 
capabilities  in  the  near  future)  and  consider  "far-term"  to 
represent  the  next  "block  change"  (next  system  modifica¬ 
tion),  which  could  occur  in  a  few  short  years.  Similar 
examples  exist  for  risk  and  effectiveness  C1443. 

The  point  is  that  a  majority  of  the  MSSTP  inputs  are 
qualitative  in  nature,  highly  subjective,  and  elicited  in  an 
uncertain  environment.  The  net  result  is  that  outcomes  from 
MSSTP  based  decisions  cannot  be  predicted  using  determin¬ 
istic  or  probabi listic  methods.  Unless  approaches  are 
adopted  by  STC  to  standardize  methods  for  eliciting  data, 
checking  for  consistency,  and  accounting  for  the  subjec¬ 
tivity  in  the  estimates,  we  believe  that  output  from 
quantitative  decision  models  will  be  ineffective  in  projec¬ 
ting  or  planning  space  RScD  needs  for  the  future. 

The  MSSTP  Methodology  Mav  Not  Surface  ftll  Critical 
Technology  Issues.  The  methodology  depends  on  several 
factors  to  identify  critical  space-related  technology 
issues.  These  include:  military  tasks,  performance  parame¬ 
ters,  consideration  of  technology  trends  and  forecasts 
(projected  SOA) ,  and  concepts.  Due  to  the  uncertainty 
associated  with  the  process  for  deriving  these  factors,  the 
technology  issues  surfaced  by  the  process  may  not  completely 
represent  the  critical  issues  that  need  to  be  resolved  to 
meet  future  military  space  requirements. 


Recall  that  technology  needs  for  the  future  were  to  he 
identified  by  selecting  tasks  that  represented  potential 
space  requirements  of  the  future.  Volume  I  of  the  liSSTP 
recognized  that  this  task  list  could  not  be  generated  simply 
by  extrapolating  current  tasks  forward  in  time.  Instead, 
projected  threats  were  hypothesized  and  tasks  necessary  to 
meet  these  threats  were  defined.  Performance  parameters  to 
accomplish  each  task  were  derived  by  focusing  on  the  mission 
requirements  to  support  each  task  and  then  evaluating  these 
requirements  in  terms  of  quantitative  figures  of  merit. 
Concepts  linked  to  military  requirements  would  ultimately 
define  technology  issues  to  be  resolved  to  provide  the 
capability  to  build  future  military  space  systems. 

However,  as  we  painted  out  in  our  discussion  of  Volume 
I,  there  were  problems  with  this  task  list.  We  noted  that 
there  was  inconsistency  in  describing  tasks,  which  was  sub¬ 
stantiated  in  discussions  with  STC  personnel  C1443.  This 
resulted  in  some  overlap  of  task  descriptions,  and  overlap 
between  tasks  and  missions.  Even  though  threat  projections 
(based  on  imperfect  information)  were  used  to  extrapolate 
tasks  into  the  future,  tasks  were  still  "filtered”  through 
current  policies  and  doctrine.  Volume  I  cites  doctrinal 
guidance  as  published  in  Air  Force  directives  and  national 
space  policies  as  factors  used  to  derive  tasks.  Additional¬ 
ly,  while  published  doctrine  reflects  the  philosophy  that 
"space  is  a  place"  where  military  missions  can  be  conducted, 
mission  descriptions  still  reflect  separate  space  missions 


C6:2-61.  While  these  factors  did  not  readily  appear  to  be 
constraining.  Me  noted  during  the  prioritization  process  at 
STC  that  group  members  tended  to  consider  policy  and  doc¬ 
trine  (as  expressed  by  current  military  thinking)  when  eval¬ 
uating  concepts.  For  example,  man-in-space  issues  were 
deleted  as  technology  issues  for  one  concept  because  group 
members  felt  that  current  military  policy  did  not  support  a 
military  manned  presence  in  space. 

Performance  parameters  were  to  provide  quantitative 
measures  of  task  requirements.  They  were  derived  by  pro¬ 
jecting  future  threats  and  capabilities  for  each  task.  As 
we  have  already  discussed,  projecting  an  adversary's  capa¬ 
bilities  and  intentions  for  a  future  timeframe  is  an 
uncertain  process.  In  our  discussion  of  Volume  I  we  also 
indicated  some  of  the  problems  encountered  in  deriving  per¬ 
formance  parameters.  The  net  result  is  that  many  of  the 
tasks  do  not  have  performance  measures  specified  for  them, 
and  where  they  are  specified,  they  may  be  off  by  as  much  as 
an  order  of  magnitude  Cl 44 J.  Since  performance  parameters 
were  ultimately  used  to  help  identify  requirements  to  be  met 
by  technology  issues,  incomplete  or  inaccurate  performance 
levels  could  mean  that  all  critical  technology  issues  have 
not  been  identified. 

Similarly,  the  working  definition  of  projected  state- 
of-the-art  (SOA)  technology  could  possibly  result  in  some 
technology  issues  not  being  identified  as  such.  Recall  that 
technology  issues  were  defined  as  the  difference  between 


concept  performance  requirements  and  the  projected  SOA  tech¬ 


nology  to  support  the  requirements.  If  a  technology  was 
projected  to  provide  the  required  capability  five  years 
prior  to  the  concept  IOC,  then  no  technology  issue  was 
defined.  However,  technology  projections  are  subject  to 
large  degrees  of  uncertainty.  Volume  III,  which  detailed 
technology  trends  and  forecasts,  lists  certain  projected 
capabilities  that  are  projected  to  be  available  only  if 
funded  and  initiated  at  given  times  and  levels.  Other 
projections  are  based  on  technology  programs  underway  but 
not  complete;  or  funded,  but  not  yet  initiated.  There  are 
no  guarantees  that  these  programs  will  deliver  promised 
capabilities  on  time  and  at  cost.  In  fact,  the  chances  are 
they  will  not  C1923.  Obviously,  if  projected  SOA  fails  to 
deliver  the  promised  technology  five  years  prior  to  concept 
IOC,  then  it  should  have  been  identified  as  a  technology 
issue  in  the  first  place.  We  believe  a  more  realistic 
approach  is  to  define  all  technology  shortfalls  that  cannot 
be  met  with  current  technology  as  technology  issues. 

We  also  note  that  the  concept  linkage  used  to  identify 
technology  issues  does  not  address  the  extent  to  which 
concepts  support  task  requirements.  An  obvious  goal  of 
deriving  tasks  to  meet  future  requirements  is  to  determine 
performance  levels  for  these  tasks.  Assuming  performance 
requirements  are  known  with  certainty  (they  are  not),  and 
that  current  technology  will  not  provide  the  capability 
required,  then  the  difference  between  current  (and/or  pro- 
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jected)  capabilities  and  task  performance  requirements 
should  identify  technology  deficiencies.  Concepts  are 
linked  to  tasks  (through  mission  requirements/functions)  to 
show  that  they  in  some  way  support  task  accomplishment. 
However,  they  do  not  identify  the  extent  to  which  they 
support  task  requirements.  It  is  possible  then  that  in 
cases  where  concepts  marginally  contribute  to  task  accom¬ 
plishment,  other  technology  deficiencies  may  exist  and 
should  therefore  be  identified  and  addressed. 

The  process  also  does  not  comprehensively  identify  the 
support  architecture  needed  to  deploy,  employ,  or  sustain 
the  concepts  if  they  are  built.  These  support  issues  are 
largely  ignored  except  for  some  special  cases  (as  is  the 
case  with  the  heavy  lift  vehicle  and  orbital  transfer 
vehicle  concepts).  As  a  result,  some  critical  technology 
issues  may  go  undefined  that  are  crucial  to  the  successful 
employment  of  the  concepts.  This  point  was  raised  by 
various  group  members  during  the  priori tization  of  technol¬ 
ogy  issues  last  summer.  Group  members  pointed  out  that  some 
concepts  called  for  large,  space-based  structures,  and  that 
the  capability  or  "proven"  technology  for  constructing  large 
structures  in  space  does  not  currently  exist.  Furthermore, 
there  were  no  concepts  that  addressed  these  types  of  capa¬ 
bilities.  The  group  guidelines,  however,  were  to  avoid 
consideration  of  support  requirements. 

Finally,  the  linkage  to  concepts  is  a  two-edged  sword 
in  the  technology  advocacy  process.  STC's  goal  is  to  ensure 


a  broad  technology  base  -for  the  -future  which  supports  a  wide 
range  of  options  and  potential  space-based  concepts  E2281. 
From  this  perspective,  it  is  best  to  divorce  technology 
advocacy  from  direct  linkage  to  concepts.  However,  by 
linking  technology  issues  directly  to  concepts  the  possibil¬ 
ity  exists  that  STC  may  find  itself  involved  in  advocating 
specific  concepts  to  ensure  consideration  for  critical  tech¬ 
nology  issues.  Thus,  the  organization  could  find  itself 
embroiled  in  the  politics  of  advocating  sensitive  concepts 
and  diverted  from  the  goal  of  ensuring  adequate  support  and 
funding  for  the  technology  issues  and  programs  themselves. 

Concept  Linkage  in  the  MSSTP  Hierarchy.  Consideration 
of  these  factors  —  task  and  performance  parameter  deriva¬ 
tion,  projected  SOA,  and  concept-linkage  —  indicate  that 
the  chance  exists  that  not  all  critical  technology  issues 
may  be  addressed.  We  believe  that  concepts  are  a  useful 
mechanism  for  identifying  technology  issues,  but  others 
exist  as  well.  We  discuss  these  other  approaches  in  Chapter 
Five.  On  the  other  hand,  we  think  that  concepts  should  be 
used  only  to  identify  potential  technology  issues,  and  not 
be  linked  back  to  military  tasks  as  part  of  the  technology 
issue  prioritization  process. 

Both  the  MSSTP  and  TRUMP  use  a  "mission  needs"  hierar¬ 
chy  to  show  linkages  between  missions,  tasks,  functions 
(mission  requirements),  technology  issues,  and  technology 
programs.  In  the  case  of  the  MSSTP,  we  noted  that  the 


hierarchy  is  implicit  (not  actually  diagramed). 


while  with 


TRUMP,  it  was  explicit  in  the  database  organization.  Both 
highlighted  that  tasks  (missions  in  the  TRUMP  hierarchy) 
were  weighted  by  the  Air  Sta-f-f  using  mission  area  analysis 
(assigning  utility  values  based  on  the  relative  importance 
of  the  various  elements).  Although  the  MSSTP  no  longer 
attempts  to  prioritize  concepts  on  the  basis  of  mission  area 
analysis,  concepts  are  retained  in  the  hierarchy,  some  by 
priorities  assigned  through  other  processes.  This  is  to 
show  linkage  to  military  tasks,  yet  concept  descriptions  do 
not  reflect  the  extent  to  which  they  support  these  tasks. 
We  see  no  benefit  in  maintaining  the  linkage  after  technol¬ 
ogy  issues  have  been  identified. 

On  the  other  hand,  linkage  of  technology  issues  to 
higher  levels  in  the  hierarchy  should  be  maintained.  If 
performance  parameters  can  be  better  specified  in  terms  of 
identifying  projected  task  requirements,  then  they  would 
represent  excellent  quantifiable  technology  goals.  Technol¬ 
ogy  issues  could  be  linked  to  these  goals  and  evaluated  in 
quantifiable  terms  as  to  the  degree  of  support  they  provide. 
We  do  not  propose  that  such  a  methodology  would  necessarily 
work  to  identify  all  critical  technology  issues.  Certainly 
some  issues  would  surface  simply  by  comparing  differences  in 
performance  requirements  and  current  or  projected  capabili¬ 
ties.  However,  other  issues  would  not  necessarily  surface 
through  such  an  analysis. 

For  example,  assume  a  given  surveillance  requirement 
calls  for  10  million  infrared  sensing  elements  to  provide  a 


required  resolution  capability  called  for  in  a  task.  A 
technology  issue  could  be  easily  defined  to  resolve  the 
difference  between  current  state  of  the  art  and  the  pro¬ 
jected  resolution  requirement.  However,  other  possible 
technology  issues  relating  to  heat  dissipation,  materials, 
or  pointing  and  tracking  problems  necessary  to  put  the 
sensing  elements  in  operation  may  not  be  directly  defined 
from  this  process. 

The  important  point  here  is  that  retaining  the  linkage 
between  concepts  and  tasks  in  the  hierarchy  after  technology 
issues  have  been  defined  can  be  misleading.  Since  concepts 
do  not  show  the  extent  to  which  they  support  task  accom¬ 
plishment,  no  meaningful  conclusions  can  be  inferred  from 
the  linkage,  other  than  the  concept  supports  the  task  to 
which  it  is  connected  to  some  degree.  TRUMP  did  not  make 
this  distinction  when  prioritizing  concepts  on  the  basis  of 
utilities  assigned  higher  level  elements  to  which  concepts 
were  connected.  This  may  have  been  one  more  reason  why  it 
was  ultimately  abandoned  as  a  methodology  for  optimizing  a 
space  technology  plan. 

Conclusion. 

In  this  chapter  we  presented  a  brief  overview  of  the 
MSSTP  and  TRUMP  processes,  and  summarized  STC  attempts  to 
implement  the  MSSTP.  The  last  section  provided  a  brief 
analysis  of  some  of  the  limitations  we  found  with  the 
methodology.  Our  ultimate  objective,  as  stated  in  Chapter 
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is  to  present  a  decision  support  structure  -for 


One, 

advocating  space-related  R&D  issues.  The  emphasis  in  this 
chapter  has  been  on  the  problems  and  limitations  o-f  the 
current  methodology.  Taking  some  of  these  concerns  into 
account  in  our  proposed  structure,  we  hope  to  improve  on  the 
current  process. 

Using  the  background  provided  in  this  and  earlier 
chapters,  we  describe  the  environment  in  which  the  space  RStD 
advocacy  process  must  operate  in  the  next  chapter.  This 
description  leads  logically  to  an  alternative  hierarchical 
approach.  We  present  this  hierarchy  in  Chapter  Five. 

The  MSSTP  and  TRUMP,  both  present  a  hierarchical  ap¬ 
proach  to  evaluating  the  R8tD  advocacy  problem.  The  hier¬ 
archy  is  implicit  in  the  MSSTP,  with  national  policies, 
national  security  objectives,  and  doctrine  discussed  in  the 
context  of  ultimately  defining  military  tasks.  While 
there  was  no  direct  connectivity  shown  between  these  ele¬ 
ments  and  military  mission  areas,  linkages  to  lower  level 
elements  were  clearly  defined.  Although  the  TRUMP  hierarchy 
was  explicitly  diagramed,  it  did  ;->ot  reflect  linkages  (as¬ 
sumed  or  otherwise)  above  mission  areas.  Both  hierarchies 
have  been  combined  in  Figure  3-6.  The  hierarchy  we  present 
in  Chapter  Five  completes  the  linkages  between  national 
needs  and  military  missions. 

The  MSSTP  used  a  hierarchical  approach  to  show  the 
linkages  between  military  tasks  and  technology  issues 
through  concepts.  In  the  process  of  deriving  tasks,  the 
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tional  environment  where  military  missions  can  be  performed 
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or  supported,  it  still  shows  space  as  a  separate  mission 
category.  This  causes  some  confusion  when  linking  space 
related  missions  to  the  DOD  mission  needs  tree  described  in 
this  chapter.  For  example,  one  of  the  specific  responsibil¬ 
ities  for  space  systems  is  to  provide  force  enhancement  to 
other  mission  areas.  Thus,  "ballistic  missile  accuracy 
enhancement"  is  defined  as  a  task  in  the  MSSTP.  The  hierar¬ 
chy  we  present  avoids  this  confusion  by  explicitly  including 
consideration  for  "space  as  a  place  where  military  missions 
can  be  performed."  Furthermore,  we  propose  that  policies 
and  operational  doctrine  (what  we  will  define  as  organiza¬ 
tional  doctrine)  should  not  be  as  influential  as  they  are  in 
the  MSSTP  for  identifying  tasks  and  ultimately  technology 
issues.  We  believe  the  minor  modifications  we  recommend 
allow  for  greater  flexibility  when  evaluating  technology 
issues  as  they  relate  to  projected  operational  requirements 
defined  by  the  tasks. 

Finally,  we  suggest  additional  linkages  to  national 
needs  other  than  through  the  mission  needs  tree  to  address 
potential  R&D  issues  that  might  otherwise  be  excluded  in  a 
mission  area  analysis.  These  R&D  issues  directly  relate  to 
the  higher  level  needs  of  "maintain  technological  advantage" 
and  "prevent  technological  surprise".  While  Volume  I  dis¬ 
cusses  these  needs,  which  are  directed  responsibilities  of 


the  R&D  effort  (as  specified  in  Air  Force  doctrine),  they 
are  not  explicitly  incorporated  in  the  mission  needs  hierar- 
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IV.  R&D  Decision  Environment 


Introducti on 

In  Chapter  Three  we  pointed  out  that  some  of  the  prob¬ 
lems  with  the  MSSTP  were  due  to  the  dynamic  nature  of  the 
process  and  the  environment  in  which  it  exists.  Volume  I  of 
the  MSSTP  addressed  the  doctrinal  and  policy  sources  for 
military  tasks  in  an  attempt  to  describe  the  environment  in 
which  the  space  R&D  advocacy  process  operates.  It  pointed 
out  that  to  be  responsive  to  future  military  requirements  in 
space  and  to  hedge  against  technological  surprise,  we  had  to 
do  more  than  simply  project  current  tasks  into  a  future 
timeframe.  The  technique  Volume  I  described  to  deal  with 
these  needs  was  to  project  threats  and  required  capabilities 
through  the  year  2010.  Based  on  these  projections,  tasks 
were  defined  to  meet  future  mission  needs  in  space.  These 
were  linked  down  through  technology  issues  in  a  hierarchical 
structure  to  show  connectivity  between  technology  issues  and 
future  mission  needs. 

In  this  chapter  we  present  a  more  expanded  description 
of  the  environment  in  which  the  space  R&D  advocacy  process 
operates.  Several  environmental  factors  are  discussed  which 
ultimately  tie  the  R&D  process  to  satisfying  national  inter¬ 
ests.  By  no  means  is  this  discussion  complete.  The  intent 
is  to  provide  a  flavor  of  the  many  external  and  internal 
factors  that  influence  space  technology  advocacy. 

This  discussion  primarily  focuses  on  the  linkage 
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between  doctrine,  one  of  the  environmental  factors  we  intro¬ 


duce,  and  space-related  R&D.  We  show  how  an  RScD  strategy 
must  be  firmly  founded  in  doctrine  in  order  to  satisfy 
national  security  objectives  and  support  national  interests. 
Our  efforts  here  focus  on  providing  a  clear  picture  of  what 
doctrine  is  and  why  it  is  essential  that  it  be  a  major 
influence  on  any  space  R&D  strategy.  This  discussion  also 
establishes  the  unique  relationship  that  exists  between 
technology  and  doctrine.  The  purpose  for  describing  our 
perception  of  the  RStD  decision  environment  is  to  provide  a 
foundation  for  an  alternative  hierarchical  model  for  evalu¬ 
ating  space  technology  issues.  The  discussion  in  this 
chapter  leads  into  the  presentation  in  the  next  chapter  of 
our  hierarchy  and  qualitative  criteria  to  evaluate 
technology  issues  (technology  issue  worth  assessment). 

The  Environment 

What  we  have  lost  in  military  matters  in  this 
generation  is  time.  Time  has  been  our  solvent, 
teacher,  and  our  friend  in  all  the  wars  of  our 
history.  It’s  no  longer  there  and,  in  its  place, 
we  must  substitute  a  readiness  composed  of  several 
i ngredi ents. .. modern  weapons. .. autonomous  mobil¬ 
ity.  .. prof essional ism  C6:3-13. 

General  David  C.  Jones 

The  military  R&D  environment  is  dynamic,  uncertain,  and 
complex.  Environmental  factors  change  in  importance  and 
scope,  and  these  changes  can  impact  R&D  efforts  in  many 
ways.  Despite  the  best  of  efforts,  the  identity,  much  less 
the  impact,  of  these  factors  are  often  unknown.  The  dynamic 
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and  uncertain  nature  of  the  environment,  which  is  heightened 
by  the  number  of  environmental  factors,  the  degree  of  inter¬ 
action  and  dependency  among  these  factors,  and  their 
combined  effects  on  the  military  R&D  process,  contribute  to 
this  complexity. 

In  spite  of  this  complexity,  it  is  necessary  to  de¬ 
scribe  some  of  the  important  factors  that  impact  the  nature, 
aims,  and  objectives  of  military  R&D.  While  such  a  discus¬ 
sion  can  never  be  complete,  it  does  serve  to  focus  attention 
on  some  of  the  critical  factors  to  which  R&D  is  particularly 
sensitive. 

Description  of  the  environment,  and  its  affect  on  the 
nature  of  R&D,  centers  on  six  factors:  operational  require¬ 
ments,  projected  threat,  national  security  objectives  and 
policies,  resource  availability,  the  physical  environment, 
and  doctrine.  Although  these  factors  are  worthy  descrip¬ 
tors,  they  are  not  necessarily  independent  nor  collectively 
exhaustive.  However,  they  adequately  describe  some  of  the 
important  envi ronmental  interactions  in  the  military  R&D 
process.  These  interactions  are  illustrated  in  Figure  4-1. 
This  chapter  describes  the  military  R&D  environment  in  the 
context  of  these  six  factors.  Preceeding  our  discussion  of 
these  interactions  is  a  brief  description  of  the  nature  of 
R&D,  with  emphasis  on  the  sources,  goals  and  responsibili¬ 
ties  for  research  and  development  within  the  Air  Force. 

Nature  and  Aims  of  R&D.  The  United  States  prides 
itself  on  being  technologically  superior  to  all  other 


The  Japanese  challenge  us  in  such  areas  as  steel  pro¬ 
duction,  mi croel ectronics,  satellites,  biotechnology,  and 
artificial  intelligence  [255:463.  In  fact,  they  have  taken 
the  lead  in  microelectronics  and  telecommunications  technol¬ 
ogy,  and  are  the  top  exporters  in  these  high  technology 
markets  [247:613.  The  Soviet  Union  and  many  European  na¬ 
tions  compete  directly  with  us  in  exporting  high  technology 
weapons  systems  to  nations  throughout  the  world.  The  USSR 
has  made  significant  technology  advances  in  directed  energy 
weapons  [257:1013  and  threatens  to  make  a  technology  break¬ 
through  in  space-based  radar  systems  capable  of  detecting 
our  SCBN  fleet  [259;  2603.  We  further  discuss  Soviet  R&D 
efforts  when  we  discuss  the  threat  as  an  environmental 
factor . 

The  US  response  to  the  technology  crisis  under  the 
Reagan  administration  has  been  to  "create  a  climate  condu¬ 
cive  to  research  and  development  that  would  improve 
competitiveness  and  product i vi ty "  and  to  "forgo  the 
'government  as  subsidizer'  role"  [75:383.  Through  various 
actions  this  administration  has  encouraged  private  industry 
to  take  the  lead  in  developing  and  funding  their  own  R&D 
efforts.  For  example,  Reagan  supports  a  bill  to  make  perma¬ 
nent  the  25X  tax  credit  for  incremental  R?<D  expenditures 
(above  a  firm’s  average  outlays  over  a  previous  three  year 
period),  which  is  currently  due  to  expire  on  31  December 
1985.  He  also  supports  the  Joint  Research  and  Development 
Act  (in  joint  committee  as  of  October  1984)  which  provides 


partial  relie-f  -from  antitrust  laws  to  companies  banding 
together  to  do  research  they  might  not  do  alone  [104:42-433. 
Several  companies  have  already  combined  their  resources  into 
R&D  "consortia"  to  push  basic  research  in  generic  areas 
which  benefit  all  participants  [255:501.  There  are  many 
other  examples  where  industrial  interests  and  professional 
organizations  have  combined  efforts  to  focus  and  apply  R&D 
resources  C4j  112;  1211. 

This  does  not  mean  that  the  federal  government  does  not 
subsidize  R8<D.  The  proposed  fiscal  year  1985  budget 
includes  $53.1  billion  for  R&D,  a  14%  increase  over  1984. 
According  to  George  Keyworth,  the  President’s  science 
advisor,  the  federal  government  has  increased  the  level  of 
funding  "out  of  a  sense  of  urgency  attached  to  the  loss  of 
America’s  technological  edge"  C75:391.  However,  the  Admin¬ 
istration  has  been  selective  in  where  the  monies  are 
applied.  For  example,  President  Reagan  signed  into  law  the 
Small  Business  Innovation  Research  Act  in  1982.  This  act  is 
designed  to  increase  the  amount  of  federal  R&D  funding  to 
businesses  with  less  than  500  employees.  One  of  the  major 
reasons  for  this  legislation  was  that  studies  showed  that 
small  firms  averaged  2.5  more  innovations  per  employee  than 
larger  firms  and  commercialized  these  innovations  one  year 
faster  and  at  25%  of  the  cost  [48:513.  However,  most  of  the 
increases  in  federal  R&D  funding  have  gone  into  military 
R&D  efforts.  In  fact,  over  the  last  four  years,  federally 
supported  defense  related  R&D  has  increased  by  657.,  while 


non-defense  R&D  has  actually  decreased  by  about  30%  E75:39D. 

There  are  several  organizations  and  individuals  who 
play  a  part  in  how  these  monies  are  spent.  Congress,  the 
Executive  Branch,  the  Department  of  Defense,  and  each  of  the 
Services  have  dedicated  organizations  to  oversee  or  manage 
DoD  related  R&D  direction  and  spending.  Within  the  Depart¬ 
ment  of  Defense,  each  Service  has  laboratories  responsible 
for  directly  managing  R8tD  programs,  and  the  Defense  Advanced 
Research  Projects  Agency  (DARPA)  manages  RS<D  efforts  that 
may  jointly  apply  to  more  than  one  Service.  A  great 
majority  of  DoD  related  research  and  development  is  accom¬ 
plished  by  private  industry,  either  through  government 
contracts,  independent  R?tD  (IR&D),  or  technology  spin-offs 
resulting  from  commercial  R&D  efforts. 

The  Air  Force  Systems  Command  (AFSC)  has  overall 
responsibility  for  R&D  management  within  the  Air  Force. 
Among  other  responsibilities,  AFSC  is  tasked  with  planning, 
formulating,  and  executing  research  and  exploratory  develop¬ 
ments  consistent  with  Air  Force  policy  and  resource 
allocation  and  for  managing  an  overall  R&D  program  that  is 
responsive  to  Air  Force  requirements  [10:33.  The  opera¬ 
tional  commands  are  responsible  for  identifying  operational 
needs  that  cannot  be  met  by  existing  systems  and  submitting 
these  requirements  for  consideration  or  validation.  AFSC  is 
responsible  for  ensuring  that  operational  requirements  are 
addressed  by  R&D  efforts  designed  to  resolve  operational 


shortfalls  C93. 


AFSC  has  -five  major  product  divisions  which  super¬ 
vise  various  Air  Force  1 aboratories.  These  product  divi¬ 
sions  are:  the  Armament  Division  at  Eglin  AFB,  Florida;  the 
Electronic  Systems  Division  at  Hanscom  AFB,  Massachusetts; 
the  Aerospace  Medical  Division  at  Brooks  Medical  Center, 
Texas;  the  Aeronautical  Systems  Division  at  Wright  Patterson 
AFB,  Ohio;  and  the  Space  Division  at  Los  Angeles  AFS,  Cali¬ 
fornia.  The  Space  Technology  Center  at  Albuquerque,  New 
Mexico,  was  formed  in  1982  under  Space  Division  to  supervise 
the  Geophysics,  Rocket  Propulsion,  and  Weapons  laboratories 
[45:561.  Laboratories  are  charged  with  providing  the  Air 
Force  "scientif ic,  engineering,  and  analytical  support  in 
creating  new  weapons,  vehicles,  and  equipment,  and  devel¬ 
oping  future  concepts  and  capabilities."  They  also  "provide 
the  principal  Air  Force  interface  with  the  scientific  and 
technological  communities"  and  "support  evaluation,  analy¬ 
sis,  and  test  activities  of  system  program  offices"  [11:11. 

A  majority  of  the  research  and  development  work  is  not 
actually  performed  by  the  laboratories,  but  is  contracted  to 
various  private  industries  and  nonprofit  research  activities 
[143:531.  Key  among  the  nonprofit  corporations  that  support 
the  Air  Force  are  four  Federal  Contract  Research  Centers 
(FCRCs) .  These  are  the  RAND  Corporation,  MITRE  Corporation, 
Lincoln  Laboratory  of  MIT,  and  the  Aerospace  Corporation. 
These  nonprofit  corporations  were  formed  to  help  the 
Services  "achieve  operational  and  technological  superiority" 
[86:701.  For  example,  the  Aerospace  Corporation  provides 


the  Air  Force  Wi  _!*  systems  engineering  and  integration  sup¬ 
port  for  a  Vo.  '  ety  of  space  systems. 

R?<D  programs  are  identified,  managed,  and  funded  ac¬ 
cording  to  a  structured  format  that  lists  various  elements 
to  identify  each  program  (see  Table  IV-1  C10:53).  Air  Force 
RStD  program  designators  begin  with  the  numeral  "6"  and  are 
broken  out  into  various  categories.  We  discuss  four  catego¬ 
ries  of  interest  E83. 

61xx  programs  are  defined  as  basic  research  efforts. 
They  are  studies  and  experimentation  designed  to  increase 
scientific  knowledge  directly  related  to  long-term  national 
security  needs.  Basic  research  not  only  provides  the  funda¬ 
mental  knowledge  for  solving  identified  problems,  but  also 
provides  a  foundation  for  subsequent  research  in  defense- 
related  technologies  that  may  lead  to  new  or  improved 
military  capabilities. 

62xx  programs  deal  with  exploratory  development.  These 
programs  range  from  fundamental  applied  research  to  sophis¬ 
ticated  experiments  to  solve  a  specific  military  problem. 
They  include  studies,  investigations,  planning,  programming, 
and  minor  development  efforts.  Exploratory  devefopment  is 
designed  to  develop  and  evaluate  the  feasibility  and 
pract i cabi 1 i ty  of  proposed  solutions  and  determine  their 
parameters.  Program  control  is  usually  exercised  by  level 
of  effort  funding. 

63xx  is  the  designator  for  advanced  development  pro¬ 
grams.  These  are  projects  that  have  moved  into  the  develop- 
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1 .  Research 

2.  Exploratory  Development 

3.  Advanced  Development 
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2.  General  Purpose  Forces 
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ment  of  hardware  for  experimental  or  operational  testing 
(not  items  designed  and  engineered  for  eventual  military 
use).  They  consist  of  investigative  and  analytical  develop¬ 
ment  planning  efforts  contributing  to  technology  guidance. 
Program  control  is  usually  exercised  on  a  project  basis. 

Lastly,  64xx  programs  deal  with  engineering  develop¬ 
ment.  These  are  development  programs  that  are  engineered 
for  military  use  but  not  yet  approved  for  acquisition  or 
operation.  They  also  include  operational  support  projects 
consisting  of  numerous  small  individual  items,  not  integral 
to  a  major  project,  that  are  being  engineered  for  military 
use.  Program  control  is  exercised  by  review  of  individual 
projects. 

All  Air  Force  R&D  efforts  are  categorized  by  one  or 
more  of  these  designators.  For  example,  a  given  project 
could  require  both  basic  research  (61xx>  and  exploratory 
development  (62xx).  However,  operational  system  develop¬ 
ments  are  not  part  of  this  formalized  R&D  program.  Opera¬ 
tional  system  development  projects  include  R&D  efforts 
directed  toward  the  "development,  engineering  and  test  of 
systems,  support  programs,  vehicles,  and  weapons  that  have 
been  approved  for  production  and  Service  employment."  They 
are  controlled  by  reviewing  the  R&D  effort  associated  with 
each  weapon  system  program  element  C10:2D. 

Fundamental  to  the  Air  Force  R&D  program  is  that 
research  must  be  "oriented  toward  advancing  the  technology 
base  and  solving  military  problems."  AFR  80-4, 


"Air  Force 


Policy  On  The  Support  o-f  Research"  also  states  that  the 
research  effort  must  "stimulate  and  support  Air  Force  tech¬ 
nical  areas  to  prevent  technological  surprise  and  to  guaran¬ 
tee  technological  leadtime,  (as  well  as)  provide  a  strong 
scientific  base  of  fundamental  knowledge  and  new  ideas." 
Sufficient  resources  must  be  allocated  to  support  a  compre¬ 
hensive  research  program  that  maintains  "a  balance  between 
research  done  to  solve  specific  problems  and  research  done 
to  stimulate  and  support  the  basic  sciences  that  underlie 
future  technology  requirements  of  the  Air  Force"  [12: 13. 

However,  funding  of  basic  research  is  severely  con¬ 
strained.  The  balance  between  basic  research  to  support 
future,  unspecified  needs  and  RS«D  to  solve  specific  known 
operational  problems  is  often  skewed  in  favor  of  the  more 
immediate  needs.  There  is  concern  that  "technologies  with 
high  promi se  for  near-term  application  could  be  overempha¬ 
sized  at  the  expense  of  others  less  urgent  for  now  but 
indispensable  for  far— term  systems"  [45:573.  Nevertheless, 
given  the  limited  resources  available  for  R?<D,  the  strategy 
of  the  Air  Force  R?<D  program  today  is  to  "go  after  those 
technologies  that  offer  the  highest  payoff  with  low  or 
limited  risk  in  order  to  field  capabilities  that  the  Air 
Force  needs  at  a  cost  the  nation  can  afford"  [67:393. 

This  concludes  our  discussion  of  the  nature  of  R&D.  We 
have  only  provided  a  "broad-brush"  treatment  of  the  subject. 
Our  intent  was  to  introduce  the  major  players,  factors, 
goals,  and  scope  of  R&D,  with  particular  emphasis  on  the  Air 


Force  R&D  program.  We  have  not  addressed  the  causes  -for  the 
technology  crisis  we  face  today,  nor  have  we  explored  the 
problems  dealing  with  defense-related  industries  and  their 
inability  or  unwillingness  to  assume  more  of  the  burden  for 
R&D.  However,  we  have  described  some  of  the  complexities 
inherent  in  the  military  RS«D  environment.  Other  authors 
cover  these  subjects  in  detail  C63;  91;  923.  Succeeding 
sections  further  explore  some  of  these  complicating  environ¬ 
mental  factors. 

Operational  Requirements. 

Research,  development,  and  acquisition  pro¬ 
grams  assure  our  future  warfighting  capability. 
Operational  concepts  and  requirements  define  the 
nature,  aims,  and  objectives  of  the  research  and 
development  effort  [6:4-123. 

Air  Force  Manual  1-1 


"define" 

OPERATIONAL  REQUIREMENTS 

- > 

R&D 

Fundamental  Air  Force  guidance  clearly  describes  the 
interaction  between  military  capabilities  and  the  R&D  effort 
needed  to  provide  these  capabilities.  Air  Force  Manual  1-1, 
"Functions  and  Basic  Doctrine  of  the  United  States  Air 
Force,"  states  that  operational  requirements  needed  to  per¬ 
form  assigned  military  tasks  must  be  supported  by  a  strong 
R?<D  program.  It  lists  three  responsibilities  of  this  pro¬ 
gram.  First,  maintain  superiority  in  basic  research  and 
enrich  the  technological  base.  Second,  identify  new  systems 
and  system  improvements  that  meet  near  and  long  term  needs 


of  aerospace  forces.  Finally,  exploit  new  technology  that 
can  lead  to  new  concepts  of  warfare  systems  E6: 4-1 1,121. 

Air  Force  Manual  1-6  "Military  Space  Doctrine"  E81, 
further  defines  the  specific  relationship  between  R&D  and 
the  military  role  in  space.  It  states  that,  within  the 
Department  of  Defense,  "the  Air  Force  is  the  leader  in  space 
operations  and  in  requisite  technology  development  for  force 
employment  in  the  aerospace"  E8:73.  Responsibilities  in 
space  are  a  direct  extension  of  Air  Force  aerospace  func¬ 
tions,  missions,  and  tasks.  The  space  R&D  effort  must 
support  the  development  and  deployment  of  concepts  that 
perform  or  enhance  Air  Force  missions  and  tasks. 

In  fact,  AFM  1-6  discusses  several  space  related  R&D 
responsibilities.  The  first  is  to  sustain  the  potential 
for  military  operations  by  applying  superior  space-related 
technologies.  The  second  responsibility  is  to  encourage 
innovation  to  take  advantage  of  advances  in  science  and 
technology.  The  third  is  to  maintain  a  strong  research  and 
development  base  which  is  responsive  to  operational  needs 
and  ensures  that  space  systems  are  able  to  meet  military 
requirements.  The  next  responsibility  is  to  develop  and 
maintain  the  capability  to  provide  the  research,  develop¬ 
ment,  testing,  engineering,  and  life  cycle  support  required 
to  bring  into  being,  and  sustain,  military  space  systems. 


The  final  responsibl i ty  is  to  develop  the  technology  base 
and  research,  development,  and  acquisition  policies  that 
accommodate  procurement  requirements  for  space  systems 


[8:7-83. 


While  basic  Air  Force  guidance  states  that  operational 
requirements  must  de-fine  the  scope  and  nature  of  RStD 
efforts,  in  actual  practice  military  capabilities  are  often 
limited  or  enhanced  by  the  quality  of  the  technology  base. 
General  Robert  T.  Marsh,  former  Commander,  Air  Force  Systems 
Command,  stated  in  a  recent  interview  that  the  military 
instrument  of  national  power  is  dependent  on  superior  tech¬ 
nology  to  provide  "qualitatively  superior  weapons  systems  to 
deter  aggression  . . .  and  to  offset  the  numerical  advantages 
enjoyed  by  our  adversaries"  [161:423.  This  dependency  is  a 
result  of  several  factors,  the  first  of  which  is  the  in¬ 
creased  capabilities  advanced  technology  can  provide.  Also, 
the  tight  fiscal  restraints  on  military  spending  have  forced 
policy  makers  to  look  for  alternatives  to  large,  manpower 
intensive  and  costly  force  structures.  Finally,  a  reluc¬ 
tance  on  the  part  of  national  leadership  to  maintain  large 
standing  armies  during  peacetime  has  led  to  reliance  on 
highly  sophisticated  and  superior  weapon  systems  designed  to 
counter  enemy  numerical  advantages.  This  reliance  on 
advanced  technology  has  been  especially  prevalent  in  the  Air 
Force. 

General  Marsh  goes  on  to  say  that  the  role  of  research 
and  development  over  the  last  thirty  years  has  been  to 
provide  a  "storehouse  full  of  technology  just  waiting  to  be 
applied"  [161:423.  In  many  cases  R&D  was  pursued  independ¬ 
ently  of  specific  military  requirements,  and,  once  a  given 
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technology  proved  success-ful,  it  was  used  to  meet  military 
requirements.  However,  erosion  in  military  R&D  emphasis  and 
significant  commitment  to  R2<D  on  the  part  of  our  potential 
adversaries  means  that  we  can  no  longer  be  complacent  in 
believing  the  "storehouse"  shelves  will  always  be  full. 

And  yet  requirements  for  advanced  technology  are 
greater  today  than  they  have  ever  been  and  will  only  in¬ 
crease  as  military  capabilities  expand  into  space.  General 
Marsh  stated  "there  is  no  question  but  that  our  military 
future  is  heavily  tied  to  space.  The  payoff  from  space- 
based  assets  is  great  today  and  promises  to  be  even  greater 
in  the  next  century"  [161:483.  Technology  programs  to  sup¬ 
port  these  capabilities  will  be  expensive  and,  in  many 
cases,  will  take  years  to  develop  with  no  guarantee  of 
success. 

This  discussion  has  described  the  strong  linkages  that 
exist  between  RS'D  and  Air  Force  operational  requirements. 
Air  Force  guidance  as  expressed  in  AFMs  1-1  and  1-6  states 
that  our  R&D  effort  must  support  operational  requirements, 
□n  the  other  hand,  there  are  cases  where  technological 
advances  serve  to  define  new  military  capabi 1 i ti es,  which, 
in  turn,  generate  new  requirements  to  take  advantage  of 
these  new  capabi 1 i t i es.  Given  this  operational  environment, 
the  space  R2<D  advocate  must  tie  proposed  space  technology 
programs  to  operational  needs.  At  the  same  time,  he  must 
justify  exploring  those  technologies  for  which  no  direct 
connectivity  with  existing  Air  Force  requirements  can  be 
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demonstrated.  These  technologies  hold  the  promise  for 
significant  technol ogi cal  advantages  and  as  a  hedge  against 
technological  surprise  from  potential  adversaries. 

The  Threat. 


The  threat  drives  military  requirements  which,  in  turn, 
drive  military  R?<D.  Projecting  enemy  capabilities  and  com¬ 
paring  these  projections  with  current  or  forecasted  capabil¬ 
ities  to  counter  these  threats  should  identify  possible 
performance  deficiencies.  These  performance  deficiencies 
lead  to  identification  of  possible  technology  issues.  These 
technology  issues  must  then  be  addressed  by  R?<D  programs  and 
resolved  in  a  timely  manner  to  ensure  our  weapon  systems  can 
counter  the  projected  threat.  In  this  respect,  the  threat 
is  inextricably  linked  with  operational  requirements  in 
defining  and  driving  military  R&D  efforts. 

Air  Force  doctrinal  publications  recognize  this 
linkage.  Missions  and  tasks  are  defined  to  destroy,  neu¬ 
tralize,  or  negate  enemy  actions  so  as  to  resolve  conflict 
on  terms  favorable  to  the  interests  of  the  United  States. 
Projected  enemy  capabilities  drive  performance  parameters 
for  mission  tasks  to  meet  operational  requirements  which 
must  be  supported  by  the  available  technologies.  Shortfalls 
in  technology  must  then  be  addressed  by  the  military  R&D 
communi ty . 


While  simply  stated,  the  actual  process  of  quantifying 
future  performance  parameters,  which  are  then  successfully 
addressed  in  a  timely  manner  through  R!<D  efforts,  is  complex 
and  uncertain.  First  of  all,  threat  projections  are  based 
on  incomplete  or  uncertain  information.  Inaccuracies  are 
magnified  by  the  length  of  time  the  projection  attempts  to 
cover.  Second,  determining  which  mission  tasks  are  affected 
by  a  particular  projected  threat  can  be  a  difficult  process 
and  the  resulting  performance  parameters  may  not  completely 
relate  to  projected  enemy  capabi 1 i ti es.  Finally,  there  is 
no  guarantee  that  an  R?<D  program  will  provide  in  a  timely 
manner  the  capability  to  counter  the  threat.  It  can  take 
over  20  years  to  develop  a  technology  to  the  point  where  it 
can  be  used  in  a  weapon  system.  Indications  are  that  some 
of  the  technologies  being  explored  today  may  not  be  avail¬ 
able  until  well  into  the  21st  century  1161:483.  The  uncer¬ 
tainty  faced  by  long-range  planners  and  technologists  is 
best  expressed  in  the  following  quote  by  General  Bernard  A. 
Schreiver,  who  in  1959  asked: 

What  appears  to  be  a  logical  future  program? 

The  answer  is  not  easy.  It  is  very  difficult  to 
make  a  firm  prognosis  on  military  need  during  a 
twenty— year  period  for  something  as  new  and  revo¬ 
lutionary  as  ballistic  missiles,  earth  satellites, 
and  space  vehicles.  We  are  somewhat  in  the  same 
position  today  as  were  military  planners  at  the 
close  of  the  first  world  war  when  they  were  trying 
to  anticipate  the  employment  of  aircraft  in  future 
wars  C8:23. 

Despite  this  uncertainty,  some  facts  are  known  about 
the  intensity  of  the  threat  and  the  challenges  facing  the 


military  R2<D  community  to  counter  this  threat.  In  -fact, 
Secretary  o-f  Defense  Caspar  W.  Weinberger  stated  in  the 
preface  to  Soviet  Military  Power  that  the  "USSR  has  greatly 
increased  its  offensive  military  capability  and  ...  signifi¬ 
cantly  enhanced  its  ability  to  conduct  military  operations 
worldwide"  C257:961.  In  the  space  arena,  the  Soviets  are 
developing  new,  heavy-lift  vehicles,  designed  to  carry  five 
times  the  payload  of  the  U.S.  space  shuttle  to  low  earth 
orbit.  Within  two  or  three  years  they  will  probably  deploy 
a  manned  space  station  capable  of  accommodating  up  to  twelve 
cosmonauts.  And,  by  the  1990s,  they  are  likely  to  deploy  a 
large  modular  station  that  could  house  as  many  as  100 
people.  Such  a  station  could  be  used  for  command  and 
control,  reconnai ssance,  and  targeting  functions,  and,  in 
the  view  of  intelligence  experts,  "during  wartime  could 
perform  more  offensively  oriented  missions  as  well" 
C257:963.  The  Soviets  have  already  developed  and  tested  an 
anti -satel 1 i te  weapon,  and  may  have  a  limited  capability  to 
blind  some  U.S.  satellite  assets  with  ground-based  lasers. 
They  have  fully  integrated  their  space  capability  into  their 
military  force  structure  and  operate  their  space  forces  in 
conjunction  with  other  military  forces  during  major 
exercises. 

Also,  the  Soviets  have  not  ignored  the  importance  of 
R&D  in  supporting  their  force  structure.  In  a  recent  ten- 
year  period  the  Soviet  Union  outspent  the  United  States  in 
R2<D  by  more  than  $120  billion  C16l:423.  In  1960  the  per- 


centage  of  total  military  expenditures  dedicated  to  R&D  was 
about  the  same  for  both  the  United  States  and  the  USSR.  By 
1974  the  Soviets’  percentage  of  military  funding  committed 
to  RS«D  had  increased  to  three  times  that  of  the  United 
States  C 161: 493.  Likewise,  they  have  made  theft  of  western 
technology  a  major  objective  as  well  —  the  extent  of  their 
commitment  exemplified  by  the  expulsion  of  over  100  "diplo¬ 
mats"  from  western  countries  during  the  last  two  years  for 
their  attempts  to  transfer  sensitive  technologies  to  the 
Soviet  Union.  In  the  words  of  Edward  Teller,  noted 
physicist  and  "father"  of  the  hydrogen  bomb,  "we  are  not 
engaged  in  an  arms  race  but  rather  a  race  of  technology" 
C 161 : 443 . 

Obviously,  our  military  R8tD  effort  must  not  only 
address  threat  projections.  We  must  also  anticipate  that 
the  Soviets’  own  R?<D  efforts  could,  and  quite  likely  will, 
result  in  some  technological  advantages  for  them.  Given 
their  level  of  spending  and  effort  devoted  to  military  space 
applications,  it  is  quite  possible  that  Soviet  advances  in 
technology  could  negate  our  freedom  of  action  in  and 
throughout  the  aerospace.  Our  R2<D  effort  must  guard  against 
this  potential  for  technological  surprise  and  its 
disasterous  consequences. 

Resource  ftvai 1 abi 1 i tv. 


RESOURCES 
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Research  and  development  requires  resources  which  are 
scarce  and,  hence,  cannot  possibly  investigate  all  technol¬ 
ogy  issues.  Likewise,  we  have  not  maintained  a  level  o-f 
spending  in  R2<D  to  preserve  the  technological  superiority 
needed  to  counter  Soviet  numerical  advantages  and  technolog¬ 
ical  advances.  For  example,  there  was  no  real  growth  in  R&D 
funding  since  1965.  In  fact,  in  terms  of  constant  dollars, 
our  technology  investment  today  is  only  75/C  of  what  it  was 
in  1965.  When  viewed  as  the  percentage  of  Total  Obligating 
Authority  (TOA)  ,  RS<D  funding  accounted  for  just  under  2.5/C 
of  TOA  in  1965.  In  fiscal  year  1984  it  was  only  0.8/C  of  TOA 
1161:42,493. 

While  many  recognize  that  increased  R!«D  funding  is 
required,  it  is  likely  that  funding  levels  will  continue 
below  the  levels  necessary  to  guarantee  a  healthy  R&D  pro¬ 
gram.  In  fact,  RS<D  must  compete  far  a  piece  of  the  resource 
pie  with  sustainability,  larger  force  structures,  increased 
personnel  costs,  and  operations  and  maintenance  expenses. 
Addi  ti  onal  1  y,  space  R?<D  must  compete  for  limited  funds  with 
other  Air  Force  R!«D  programs.  Many  of  these  programs  have 
well  established  advocates  and  Congressional  champions, 
making  space  R?<3  advocacy  all  the  more  difficult.  Advocacy 
programs  must  not  only  demonstrate  the  relative  worth  of 
space  R?<D  programs,  but  must  also  advocate  for  and  generate 
additional  funding  to  support  a  broad  space  technology  base 
to  guarantee  a  technological  edge  over  the  Soviets.  In  the 
words  of  General  Marsh: 


The  Air  Force  must  face  up  to  the  problem 
that  it's  going  to  take  increasing  resources — over 
and  above  what  we  are  devoting  to  it  now — to 
maintain  an  adequate  technology  base.  In  terms  of 
basic  and  applied  research  funding,  we  are  at  a 
nadir  in  absolute  buying  power  £258:533. 


National  Security  Objectives  and  Policies  shape  the 
nature  of  military  R8<D.  The  basic  security  objective  of  the 
United  States  is  to  preserve  our  country  as  a  free  nation 
with  its  fundamental  institutions  and  values  intact. 
National  policies  support  this  objective  and  in  turn  depend 
upon  the  instruments  of  national  power  to  implement  these 
policies.  The  armed  forces  represent  just  one  of  many 
instruments  that  support  national  security  objectives. 

We  will  discuss  these  terms  in  greater  depth  when  we 
present  our  proposed  hierarchy  in  Chapter  Five.  However,  it 
is  important  to  note  here  just  how  these  elements  impact  R&D 
efforts.  In  particular,  National  Policies  ultimately  con¬ 
strain  military  R&D  direction  and  scope,  especially  in  the 
military  space  R&D  community. 

The  focus  of  research  and  development  is  influenced  by 
our  evolving  national  security  policies  and  our  changing 
commitments  through  mutual  security  pacts  and  arms  control 
treaties  C6:4— 123.  This  influence  is  especially  strong  on 
space  R&D  programs.  One  of  our  national  policies  is  to 


honor  treaty  commitments  and  international  law.  This  policy 
prohibits  or  restrains  our  -freedom  of  action  in  space  as  it 
relates  to  deploying  offensive  or  certain  categories  of 
defensive  weapons  in  space.  For  example,  treaties  or  inter¬ 
national  law  prohibit:  nuclear  weapon  tests  in  space; 
placing  weapons  of  mass  destruction  in  space;  constructing 
military  instal lations  or  fortif ications  on  the  moon  or 
other  celestial  bodies;  and  developing,  testing  or  deploying 
anti -bal 1 i stic  missile  systems  based  in  space  [8:3—43. 

Other  national  policies  have  remained  fairly  constant 
through  the  years.  These  include  such  broad  policies  as: 
maintain  sufficient  military  power  to  deter  threats  and 
defeat  military  actions  against  the  United  States;  accept  an 
equitable  share  of  the  collective  defense  effort  with  our 
allies;  have  available  military  action  short  of  full-scale 
war,  to  signal  our  concern  and  intent;  and  ensure  that  our 
military  actions  complement  our  political  and  other  instru¬ 
ments  of  national  power  C6:l-23. 

However,  with  changes  in  administrations  come  changes 
in  interpretations  of  what  constitutes  "sufficient," 
"equitable,"  and  "intent."  These  can  have  disasterous 
impact  on  R2<D  direction  and  efforts.  For  example,  when 
Jimmy  Carter  was  elected  President,  he  curtailed  the  B-l 
bomber  program,  MX  missile  program,  and  put  the  U.S.  ASAT 
R&D  program  on  minimum  funding  in  the  hopes  he  could  negoti¬ 
ate  a  meaningful  agreement  with  the  Soviets  concerning  use 
of  weapons  in  space.  While  these  programs  have  been 


reinstated  by  the  Reagan  administration,  costs  are  much 
higher  and  deployment  dates  slipped  by  several  years. 

Strictly  speaking,  national  policies  should  only  con¬ 
strain  operational  requirements  and  concepts.  In  other 
words,  except  in  specific  cases,  we  can  pursue  R&D  that 
potentially  supports  systems  which  if  deployed,  would  vio¬ 
late  treaties  or  international  law.  For  example,  an 
emotionally  charged  current  issue  is  the  space-based  defense 
against  ballistic  missiles  concept.  The  concept  calls  for 
placing  weapon  platforms  in  low  earth  orbits  which  would  be 
capable  of  destroying  enemy  ICBMs  before  they  strike  targets 
in  the  United  States.  Although  the  concept  calls  for 
deployment  sometime  in  the  second  decade  of  the  21st 
century,  the  R!<D  effort  to  provide  required  capabilities 
must  begin  today.  Despite  the  enthusiastic  support  of 
President  Reagan,  this  concept  has  not  gained  widespread 
support.  Many  critics  cite  the  destabi 1 i c i ng  effects  of 
pursuing  a  capability  not  shared  by  our  adversaries  (and 
thereby  increasing  the  possibility  of  nuclear  war  before  we 
can  deploy  such  a  system)  and  the  fact  that  deployment  of  a 
space— based  ballistic  missile  defense  system  would  violate 
the  ABM  Treaty.  Since  it  is  our  policy  to  honor  treaty 
commitments,  these  critics  say  that  even  pursuing  R&D  in 
these  areas  represents  a  "bad-faith"  action  on  our  part. 
This  program  is  still  facing  an  uncertain  future  in  the 
military  R&D  environment. 

The  point  is  that  when  developing  or  advocating  an  R&D 


program,  we  must  recognize  that  national  policy  can  be 
transitive  and  very  sensitive  to  dynamic  -factors.  To  meet 
long-term  R&D  needs  we  must  consider  the  constraining  nature 
of  current  policies  and  incorporate  within  an  advocacy 
program  rationale  for  supporting  R&D  that  may  not  be  in  step 
with  the  policies  of  today.  For  example.  Air  Force  gui¬ 
dance,  expressed  in  AFMs  1—1  and  1-6,  requires  us  to 
maintain  technol ogi cal  superiority  and  prevent  technological 
surprise.  Given  the  time  it  takes  to  successfully  develop 
technology  to  the  point  where  it  can  be  used  in  weapon 
systems  and  the  stiff  competition  for  limited  funding,  R&D 
programs  must  stand  on  their  own  merits  as  they  contribute 
to  mission  requirements  and  as  a  hedge  against  technological 
surpri se. 


The  physical  environment  challenges  the  R&D  effort. 
R&D  programs  attempt  to  exploit  the  advantages  of  operating 
in  a  particular  physical  medium  and  circumvent  or  counter 
the  disadvantages  and  unique  constraints  presented  by  oper¬ 
ating  in  that  medium.  For  example,  naval  R&D  efforts  may  be 
directed  towards  developing  faster,  quieter,  and  deeper 
running  submarines  for  the  U.S.  Navy.  They  seek  to  take 
advantage  of  temperature  differentials  and  current  varia¬ 
tions  which  confuse  enemy  sonar  detectors.  Along  with  this. 


they  must  develop  stronger  materials  to  withstand  the 
extreme  pressures  at  the  depths  at  which  the  submarines  must 
operate.  The  space  environment,  similarly,  has  its  advan¬ 
tages  and  disadvantages  that  challenge  space  R&D  efforts. 

General  Thomas  D.  White  is  attributed  with  having 
brought  the  term  "aerospace"  into  the  Air  Force  vocabulary 
in  1958  as  a  means  of  linking  the  endo-  and  exoatmospher i c 
media  which,  together,  constitute  the  operating  environment 
of  the  U.S.  Air  Force.  His  definition  is  still  valid  twenty- 
six  years  later: 

Since  there  is  no  dividing  line,  no  natural 
barrier  separating  these  two  areas  (air  and 
space) ,  there  can  be  no  operational  boundary  be¬ 
tween  them.  Thus  air  and  space  comprise  a  single 
continuous  operation  field  in  which  the  Air  Force 
must  continue  to  function.  The  area  is  aerospace 
C6: 2-1 1 . 

The  aerospace  medium  has  unique  characteristics  that 
offer  significant  advantages  for  military  forces  operating 
in  the  aerospace.  Character i sties  include  unlimited  hori¬ 
zontal  and  vertical  three-dimensional  movement  and  maneuver, 
and  the  capability  to  exploit  speed,  flexibility,  and  range 
to  produce  a  wide  range  of  effects  and  influences.  Examples 
of  beneficial  effects  and  influences  are:  rapid  projection 
of  power;  reduced  time  to  respond  (speed);  perform  a  variety 
of  actions  (flexibility);  and  operate  in  any  direction  over 
great  distances  (range)  C7:2-21. 

In  the  outer  reaches  of  the  aerospace,  these  beneficial 
effects  and  influences  are  magnified.  Space-based  systems 
provide  global  coverage,  do  a  variety  of  tasks,  operate  with 


great  flexibility,  efficiency,  and  in  some  cases  can  perform 
these  functions  more  economically  than  other  systems 
CS:5,63.  In  fact,  the  U.S.  is  dependent  upon  many  space- 
based  systems  as  the  sole  providers  or  performers  for  criti¬ 
cal  military  tasks.  General  Marsh  highlighted  this  point 
when  he  advocated  the  need  for  R8»D  efforts  to  provide 
survivability  or  defensive  capabilities  for  our  space 
assets,  stating,  "U.S.  space  capabilities  have  mushroomed 
and  assumed  a  paramount  role  in  this  country's  defense 
posture  without  commensurate  action  to  ensure  the  surviv¬ 
ability  of  these  assets"  C258:56D. 

On  the  other  hand,  operating  in  the  exoatmosphere  has 
some  inherent  disadvantages  which  must  be  considered.  To 
operate  in  the  medium  one  must  first  overcome  the  effects  of 
gravity,  which  drives  the  cost  for  putting  platforms  in 
space.  Because  of  its  relative  inaccessibi 1 ty,  space 
systems  must  be  designed  for  long  life  and  high  reliability, 
which  further  drive  costs  upward.  While  operating  in  a  near 
perfect  vacuum  offers  some  advantages,  it  presents  some 
significant  challenges  to  a  manned  presence  in  space.  The 
environment  is  unfriendly  and  alien  to  what  we  are  accus¬ 
tomed  to  on  earth.  Cosmic  radiation,  gravi tati onal  and 
magnetic  fields,  solar  heating,  sol ar  flare  events,  among 
others,  all  present  unique  technological  challenges. 
Because  of  the  high  costs  for  getting  to,  and  operating 
within  the  space  medium,  technologists  and  systems  planners 
must  carefully  weigh  the  benefits  for  performing  specified 
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missions  in  space  against  terrestrial  based  systems.  Only 
if  military  utility,  effectiveness,  and  suitability  clearly 
weigh  in  favor  of  space-based  alternatives  should  these  be 
actively  pursued. 

Nonetheless,  characteri sties  of  the  physical  environ¬ 
ment  offer  the  space  R&D  advocate  useful  "ammunition"  when 
arguing  the  benefits  of  space  technology.  Indeed,  the  space 
medium  offers  significant  increases  in  military  capability. 
A  significant  R&D  effort  will  be  required  to  take  full 
advantage  of  the  space  environment. 

Doctri ne. 

At  the  very  heart  of  warfare  lies  doctrine. 

It  represents  the  central  beliefs  for  waging  war 
in  order  to  achieve  victory.  Doctrine  is  of  the 
mind,  a  network  of  faith  and  knowledge  reinforced 
by  experience  which  lays  the  pattern  for  the  util¬ 
ization  of  men,  equipment,  and  tactics.  It  is  the 
building  material  for  strategy.  It  is  fundamental 
to  sound  judgment  C7:ii3. 

General  Curtis  E.  Lemay 

Doctrine,  the  final  environmental  factor,  drives,  and  at 
the  same  time  is  driven  by,  R&D  goals  and  objectives.  JCS 
Publication  1,  "Dictionary  of  Military  and  Associated 
Terms,"  defines  doctrine  as  "fundamental  principles  by  which 
the  military  forces  or  elements  thereof  guide  their  actions 
in  support  of  national  objectives.  It  is  authoritative  but 
requires  judgment  in  application"  E7:v3.  Both  AFM  1-1  C6» 
73  and  AFM  1-6  CB3  attempt  to  describe  doctrine.  AFM  1-6, 
"Military  Space  Doctrine,"  describes  the  role  of  doctrine  in 
"equipping  forces"  and  notes  the  dependence  on  both  RS<D  and 


the  acquisition  of  systems: 

The  Air  Force  will  maintain  U.S.  technolog¬ 
ical  superiority  in  the  aerospace  and  ensure  a 
prolonged  war-fighting  capability  by  developing  the 
potential  for  combat  operations  in  the  space  medi¬ 
um.  The  development  of  this  potential  requires  an 
expanded  awareness  and  an  integral  application  of 
research  and  development,  planning,  and  opera¬ 
tional  activities.  A  strong  Air  Force  research 
and  development  base,  responsive  to  operational 
needs,  is  essential  to  ensure  that  space  systems 
are  able  to  meet  military  requirements  CB:10J. 

The  thrust  of  this  doctrinal  statement  is  that  R&D  must 
be  responsive  to  operational  needs.  This  is  the  same  point 
made  earlier  in  our  discussion  of  operational  requirements 
as  an  environmental  factor.  Since  doctrine  represents  the 
basic  beliefs  by  which  our  military  forces  guide  their 
actions  in  support  of  national  objectives,  then  doctrine 
should  also  form  the  foundation  for  how  these  forces  accom¬ 
plish  their  assigned  missions  and  tasks.  Since  tasks  define 
or  describe  operational  requirements,  doctrine,  indeed, 
appears  to  "drive"  R?<D  efforts  to  support  operational 
requi rements. 


However,  in  our  discussion  of  operational  require¬ 
ments  as  an  environmental  factor  which  impacts  the  nature, 
aims,  and  objectives  of  R?<D,  we  pointed  out  that  there  are 
times  when  advances  in  technology  serve  to  generate  military 
tasks  or  capabilities  that  were  not  defined  prior  to  the 
technological  advancement.  Since  tasks  should  relate  to  our 
doctrinal  views,  then,  by  extension,  we  must  conclude  that 


"the  development  of  emerging  technologies  may  well  influence 
the  development  of  doctrine"  C7:4-83.  AFM  1-1,  "Functions 
and  Doctrine  of  the  United  States  Air  Force, “  seems  to 
support  this  position  as  well.  "Doctrine  is  dynamic.  It  is 
constantly  evolving  as  it  adapts  to  changes  in  technol¬ 
ogy..."  C6:6-6D.  So,  doctrine  is  often  shaped  by  advances 
in  technology  brought  about  through  R&D. 


"drives" 

R8<D 

- > 

DOCTRINE 

Thus,  it  appears  that  doctrine  is  unique  from  the 
other  environmental  factors  we  have  discussed.  It  both 
influences,  and  is  influenced  by  technology  realized  through 
R&D  efforts. 


“dri ves " 

DOCTRINE 

\ 

R&D 

"is  driven  by" 

Doctrine:  What  It  Is  And  Is  Not.  We  believe  that 
a  short  discussion  of  doctrine,  what  it  is  and  how  it  in¬ 
fluences,  and  is  influenced  by  technology,  is  useful  in 
helping  to  explain  this  apparent  dichotomy.  Lieutenant 
Colonel  Dennis  M.  Drew  presents  a  new  and  refreshing  per¬ 
spective  on  doctrine  and  how  it  relates,  or  should  relate, 
to  strategy  and  planning  within  the  Air  Force.  We  use  his 
article,  "Of  Trees  and  Leaves:  A  New  View  of  Doctrine,"  C783 
to  introduce  definitions  and  concepts  that  relate  to  this 
discussion  on  doctrine. 


Drew  argues  that  published  Air  Force  doctrine  is  con— 


tradictory  and 


conjures  con-fusion  and 


consternation 


C78:53.  Much  o-f  the  confusion  is  caused  by  the  fact  that 
published  doctrine  (nixes  several  categories  of  doctrine 
indiscriminately  without  differentiating  between  the  catego¬ 
ries.  Drew  suggests  that  to  understand  doctrine,  we  must 
first  understand  that  doctrine  has  three  purposes:  to  pre¬ 
serve  experience;  to  teach  lessons  learned  from  experience 
to  others;  and  to  be  a  general  guide  for  actions.  Three 
basic  categories  of  doctrine  proposed  by  Drew  fulfill  these 
purposes  in  varying  degrees.  These  categories  are  fundamen¬ 
tal,  environmental,  and  organizational  doctrine. 

Fundamental  doctrine  is  the  foundation  upon  which  all 
other  doctrine  is  derived.  It  forms  a  "philosophy  of  war” 
and  incorporates  the  basic  beliefs  about  the  nature  and 
purpose  of  war  and  the  relationship  that  exists  between  the 
military  and  other  instruments  of  national  power.  Consid¬ 
ered  within  fundamental  doctrine  are  the  "principles  of  war" 
—  the  basic  principles  for  employment  of  military  forces. 
These  are  the  same  fundamental  factors  that  successful  mili¬ 
tary  leaders  through  the  ages  have  considered,  to  varying 
degrees,  in  their  planning  and  execution  of  warfare.  They 
include:  objective,  offensive,  mass  and  economy  of  force, 
surprise,  simplicity,  maneuver,  security,  unity  of  command, 
defense,  timing  and  tempo,  and  unity  of  effort.  Fundamental 
doctrine  considers  and  interprets  these  principles  of  war 
and  their  relationship  to  the  pursuit  of  national  goals. 

Fundamental  doctrine  is  fairly  stable.  It  is  based  on 


basic  concepts  rather  than  contemporary  techniques  of  war¬ 
fare.  Because  fundamental  doctrine  is  insensitive  to 
change,  it  is  also  "relatively  insensitive  to  politics  and 
technology.  It  does  not  rely  on  the  political  philosophy 
that  controls  the  military  instrument  nor  does  it  depend  on 
the  sophistication  of  the  weapons  that  military  forces  can 
use"  [78:81.  Fundamental  doctrine  forms  the  foundation  for 
environmental  doctrine. 

Environmental  doctrine  is  a  "compilation  of  beliefs 
about  the  employment  of  military  force  within  a  particular 
operating  medium,  often  including  statements  concerning  the 
unique  purposes  and  capabilities  of  forces  operating  in  the 
medium"  C78:83.  It  is  narrower  in  scope  than  fundamental 
doctrine,  and  is  more  parochial  by  emphasizing  operations  in 
a  particular  medium.  Environmental  doctrine  can  also  be 
relatively  insensitive  to  politics  and  other  contemporary 
constraints,  but  it  is  influenced  by  geography  (or  the 
physical  environment)  and  technology.  In  fact,  aerospace 
(environmental)  doctrine  is  "totally  dependent  upon  technol¬ 
ogy  and  increasingly  dependent  on  technology’s  many  new 
gadgets"  C78:81. 

Organizational  doctrine  addresses  basic  beliefs  about 
the  operation  of  a  particular  military  organization  and 
incorporates  constraints,  current  capabilities,  and  consid¬ 
eration  for  national  cultural  values  and  policies.  It 
discusses  the  roles  and  missions  assigned  to  organizations, 
current  objectives,  and  force  employment  principles  as 


influenced  by  the  current  situation.  As  such,  it  is  not 
"timeless"  —  it  is  heavily  influenced  by  politics  and  other 
environmental  constraints. 

There  are  no  clear-cut  boundaries  between  these  doctri¬ 
nal  categories.  Fundamental  doctrine  tends  to  be  more 
abstract  than  either  environmental  or  organizational 
doctrine.  In  fact.  Drew  describes  it  as  the  "relationship 
of  military  force  to  other  instruments  of  power"  [78:73. 
Environmental  doctrine  (which  for  our  purposes  we  describe 
as  "aerospace  doctrine"  to  reflect  the  connectivity  with  the 
physical  medium  in  which  Air  Force  forces  operate)  is 
slightly  more  dynamic  than  fundamental  doctrine,  and 
certainly  more  concrete.  Emphasis  is  on  potential  appli¬ 
cations  and  operations  within  the  physical  medium.  Environ¬ 
mental  doctrine  is  bounded  by  the  physical  environment  and 
influenced  by  technology.  In  fact,  it  is  technology  that 
often  drives  the  direction  of  environmental  doctrine.  Or¬ 
ganizational  doctrine,  also  defined  as  operational  doctrine, 
is  very  dynamic.  Emphasis  is  on  the  current  way  a  military 
organization  perceives  its  assigned  missions  and  how  it 
accomplishes  those  missions  (through  tasks).  Although  firm¬ 
ly  founded  on  fundamental  doctrine  and  heavily  influenced  by 
environmental  doctrine,  operational  doctrine  is  still  con¬ 
strained  by  what  is  allowable  or  possible  under  existing 
policies,  resources,  and  technologies.  We  will  show  that  it 
is  organizational  doctrine,  through  operational  require¬ 
ments,  that  drives  current  R&D  efforts. 


We  -find  when  we  analyze  published  doctrine  that  it 
mixes  all  three  categories  o-f  doctrine.  For  example,  AFM  1- 
1,  "Functions  and  Basic  Doctrine  of  the  United  States  Air 
Force",  discusses  the  principles  o-f  war  (fundamental 
doctrine)  and  aerospace  applications  of  the  principles 
(environmental  doctrine)  in  its  Chapter  Five.  AFM  1-6, 
"Military  Space  Doctrine",  likewise  highlights  environmental 
doctrine,  as  expressed  in  this  statement:  "the  medium  of 
space  provides  an  unlimited  potential  and  opportunity  for 
military  operations  on  which  the  Air  Force  must  capitalize" 
C8:iiil.  However,  for  the  most  part  both  publications  are 
representati ve  of  organizational  doctrine  in  that  they 
relate  existing  restraints  imposed  by  policy,  treaty,  and 
laws  on  the  manner  in  which  the  military  instrument  (the  Air 
Force)  seeks  to  support  national  policies  and  interests. 


Doctrinal  Influences  on  the  R&D  Process.  From 


this  perspective  we  see  that  the  strong  emphasis  in  the 
MSSTP  for  linking  technology  issues  (drivers  for  R&D)  to 
operational  requirements  (military  tasks)  is  in  consonance 
with  organi zati onal  doctrine.  Since  organizational  doctrine 
represents  the  way  we  perceive  how  to  use  forces  to  meet 
current  and  projected  threats,  it  should  form  the  basis  for 
the  specific  tasks  necessary  to  carry  out  the  strategies  and 
tactics,  since  these  are,  or  should  be  derived  from  doctrine 
C78:10D.  Analysis  of  tasks  reveals  operational  require¬ 
ments.  These  ultimately  define  R&D  requirements  necessary 


the  systems  to  meet  required  operational 
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capabilities.  These  relationships  are  shown  in  Figure  4-2. 


Figure  4-2.  Linkage  Between  Operational  Doctrine  and  R&D 


We  can  now  relate  the  hierarchical  approach  that  the 
MSSTP  process  used  to  link  mission  tasks  and  technology 
issues  to  the  concept  of  organizational  doctrine.  Recall 
that  Volume  I  of  the  MSSTP  derived  tasks  through  mission 
area  analysis  by  projecting  threats  for  various  timeframes 
and  the  required  capabilities  necessary  to  meet  the  threat. 
This  analysis  is  almost  identical  to  that  outlined  in  AFR 
57-1,  "Statement  of  Operational  Need  (SON)",  which  provides 
regulatory  guidance  to  Air  Force  organizations  on  how  to 
formally  identify  operational  needs  C93.  Once  operational 
needs  are  determined,  they  can  be  compared  against  projected 
capabilities.  Shortfalls  are  identified  as  technology 
issues  that  R&D  efforts  must  resolve.  Thus,  we  have  shown 
that  R2*D  is  responsive  to  (driven  by)  applications  of  organ¬ 
izational  doctrine  through  operational  needs. 

At  first  glance  it  may  appear  that  a  methodology  that 
can  identify  projected  operational  requirements  and  the 
technology  issues  that  must  be  resolved  to  meet  these 


requirements  would  be  sufficient  for  surfacing  the  vast 
majority  of  critical  R?<D  efforts.  However,  there  are  prob¬ 
lems  with  adopting  this  single  approach.  We  have  already 
pointed  out  in  Chapters  Two  and  Three  the  inherent  inaccura¬ 
cies  with  most  projections  based  on  subjective  judgments. 
Recall  that  a  majority  of  the  inputs  for  the  MSSTP  are 
derived  from  such  estimates.  So  there  is  no  guarantee  that 
all  possible  operational  needs  for  the  future  will  be 
identified.  If  all  possible  operational  needs  are  not  iden¬ 
tified,  then  it  stands  to  reason  that  not  all  potentially 
critical  technology  issues  will  surface.  Consider  the 
following  discussion  which  shows  that  all  critical  issues 
may  not,  or  are  not,  identified  by  a  mission  area  analysis 
that  matches  operational  needs  to  technology  requirements. 

To  derive  operational  needs  through  a  mission  area 
analysis,  it  seems  reasonable  to  expect  consensus  on  what 
the  important  military  tasks  are  that  ultimately  define 
operational  needs.  And  yet  with  respect  to  military  appli¬ 
cations  i  i  space,  a  debate  continues  concerning  the  proper 
role  of  military  forces  in  this  part  of  the  operational 
aerospace  medium.  General  Henry,  Commander,  Space  Division, 
discussed  the  essence  of  this  debate  in  an  interview  in  June 
1982.  He  said  that  "we  have  a  debate  as  to  what  space 
operations  are,  and  whether  we're  (Space  Division)  still  in 
R&D  or  operations"  C31:383.  In  the  same  interview  General 
Henry  pointed  out  that  the  DoD  was  attempting  to  find  out 
what  the  military  mission  in  space  really  is.  From  his 


perspective,  "the  only  practicable  military  mission  that  we 
have  come  up  with  yet  is  still  the  collection,  movement,  and 
dissemination  of  military  information"  £31:363. 

Hardly  a  year  later,  General  Marsh,  the  Commander,  Air 
Force  Systems  Command,  stated  that  "there  are  all  kinds  of 
space  capabilities  one  can  conjure  up  beyond  the  limited 
spacecraft  of  today  that  simply  go  around  the  earth  due  to 
the  laws  of  physics."  He  stated  that  a  number  of  the  most 
promising  R&D  options  concern  military  operations  in  space. 
"In  the  Air  Force’s  view,"  he  said,  "space  is  a  place,  not  a 
mission,  and  it  may  be  both  feasible  and  necessary  to  con¬ 
duct  a  broad  range  of  operations  from  there  in  the  future" 
£67:393. 

There  is  clearly  a  wide  difference  of  opinion  between 
these  two  senior  Air  Force  leaders  concerning  the  military 
role  and  potential  tasks  in  space.  General  Henry  likened 
the  debate  to  similar  debates  during  the  mid-1920s  when 
aviation  was  still  in  its  infancy  and  little  consensus 
existed  concerning  military  applications  for  the  airplane 
£31:383.  However,  even  if  everyone  agreed  to  what  the 
operational  needs  for  space  were,  some  experts  doubt  that  an 
operational  needs  assessment  would  identify  all  the  critical 
technology  requirements  for  the  future. 

For  example,  during  recent  testimony  given  before  the 
House  Defense  Appropr i ati ons  Subcommittee,  Allen  E.  Puckett, 
Chairman  and  CEO  of  Hughes  Aircraft,  said,  "almost  none  of 
the  dramatic  new  technologies  of  this  century  was  conceived 


as  a  result  of  the  statement  of  a  military  requirement,  or 
the  specifications  in  a  Defense  Department  contract" 
C115:613.  He  cited  examples  of  technology  advances  that  had 
resulted  from  independent  research  and  development  (IR&D)  on 
the  part  of  private  industry  that  included:  radar,  the 
airplane,  jet  engines,  rocket  engines,  semiconductors, 
lasers,  microcircuits,  communications  satellites,  and  nucle¬ 
ar  weapons.  "The  conception  and  initial  exploration  of 
these  ideas  were  carried  out  by  members  of  our  engineering 
and  scientific  community,"  he  said,  "working  in  an  environ¬ 
ment  which  allowed  and  stimulated  novel  and  unorthodox 
thinking"  1115:613. 

We  propose  that  these  concerns  can  be  satisfactorily 
addressed  from  an  environmental  doctrine  perspective. 
Certainly  the  debate  that  is  ongoing  concerning  applicable 
military  missions  and  tasks  in  space  has  environmental 
doctrine  overtones.  General  Marsh  was  clearly  speculating 
on  the  potential  for  performing  military  tasks  in  space  and 
utilizing  the  advantages  of  the  medium  for  military  pur¬ 
poses.  In  fact,  we  believe  that  much  of  the  confusion  and 
debate  surrounding  the  military  role  in  space  can  be 
explained  as  a  "clash"  between  organizational  doctrine  and 
envi ronmental  doctrine. 

Recall  that  envi ronmental  doctrine  is  more  "free 
wheeling,"  heavily  influenced  by  technology,  but  relatively 
unconstrai ned  by  policies  and  current,  "accepted"  ways  of 
doing  things.  Another  way  of  approaching  environmental 
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doctrine  is  to  consider  it  as  an  application  o-f  the  princi¬ 


ples  of  war,  as  addressed  in  fundamental  doctrine,  in  a 
particular  operational  medium.  In  this  regard  environmental 
doctrine  represents  a  "no-man’s  land"  when  it  comes  to 
doctrinal  agreement  with  national  policies. 

We  pointed  out  that  fundamental  doctrine  does  not  rely 
on  the  political  philosophy  that  controls  the  military 
instrument.  At  the  other  extreme,  we  showed  that  organiza¬ 
tional  doctrine  is  directly  influenced  by  current  politics 
and  policy.  If  we  accept  that  environmental  doctrine  is 
defined  somewhere  between  the  two,  with  no  clear  delineation 
where  one  stops  and  the  other  begins,  then  we  should  expect 
areas  where  environmental  doctrine  conflicts  with  organiza¬ 
tional  doctrine.  Therefore,  aerospace  environmental 
doctrine  adherents  may  disagree  with  accepted  military 
"truths"  (as  represented  by  organizational  doctrine)  in 
their  advocacy  of  potential  applications  of  the  principles 
of  war  in  the  aerospace  environment.  As  new  applications 
for  military  tasks  in  the  environment  are  proposed,  dis¬ 
cussed,  and  either  accepted  or  discarded,  we  can  expect 
conflict  to  exist  between  organizational  doctrine  and  pro¬ 
posed  environmental  doctrine. 

New  military  capabilities,  or  applications  within  the 
operational  environment,  are  usually  first  argued  from  the 
perspective  of  environmental  doctrine.  There  are  times  when 
technological  advances  brought  about  (or  promised)  by  R&D 


that  support  national  security  objectives.  The  advent  o-f 
new  technologies  often  inspires  environmental  doctrinal 
thinkers  to  propose  ways  in  which  the  technology  can  improve 
the  conduct  of  military  operations  in  the  operational  medi¬ 
um.  The  following  examples  serve  to  illustrate  these 
points. 

In  the  early  1920s  General  Billy  Mitchell  and  Field 
Marshall  Guilio  Douhet  proposed  the  concept  of  strategic 
bombing.  Aircraft,  flying  higher  and  faster  than  pursuit 
aircraft  and  with  the  capability  to  defend  themselves,  could 
deliver  large  numbers  of  bombs  deep  into  enemy  territory. 
By  hitting  and  destroying  enemy  targets  deep  within  the 
enemy’s  own  territory,  strategic  bombing  could  ultimately 
win  wars,  relegating  land  and  sea  forces  to  defensive  or 
“holding"  operations  until  the  strategic  bombing  offensive 
got  underway.  Interestingly  enough,  these  theories  were 
advocated  long  before  R&D  delivered  bombers  capable  of 
performing  these  missions  (the  B-17  and  B-29) .  Nonetheless, 
this  was  a  case  where  an  idea  (generated  because  the  air¬ 
craft,  a  relatively  new  invention,  represented  increased 
potential  and  different  capabilities  for  supporting  national 
security  objectives)  evolved  into  doctrine  and  drove  the 
development  of  new  weapons  systems  to  perform  new,  previ¬ 
ously  unthought  of  tasks. 

Likewise,  the  development  of  nuclear  weapons  was  a  case 
where  technol ogi cal  advances  drove  the  development  of 
doctrine.  When  the  Soviets  developed  a  nuclear  capability 
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it  -forced  military  strategists  and  national  leaders  to 
reevaluate  all  previous  concepts  of  warfare  within  the 
context  of  nuclear  war.  From  this,  the  doctrine  of  deter¬ 
rence  was  born  —  a  doctrine  the  U.S.  adheres  to  today. 

A  more  recent  example  points  to  where  the  concurrent 
application  of  environmental  and  organizational  doctrine  can 
conflict.  It  also  serves  to  highlight  the  important  differ¬ 
ences  between  the  two  categories  of  doctrine,  and  the  impact 
both  can  play  on  the  R&D  process.  This  example  is  the 
Strategic  Defense  Initiatives  (SDI). 

The  SDI  represent  a  group  of  concepts  that  individu¬ 
ally,  or  in  some  cases  col 1 ect i vel y,  define  a  space-based 
defense  against  enemy  ballistic  missiles.  Ballistic  mis¬ 
siles  are  most  vulnerable  in  their  boost  and  post  boost 
phases  of  their  ballistic  trajectories  in  the  exoatmosphere. 
Space  weapons  systems,  such  as  lasers,  particle  beams, 
and/or  hyper  velocity  kinetic  energy  platforms  can  theoreti¬ 
cally  destroy  or  neutralize  the  vast  majority  of  an  enemy’s 
ballistic  missile  force  before  they  ever  reenter  the  atmos¬ 
phere  (See  High  Frontier  C1051  and  Ballistic  Missile  Defense 
C471  for  greater  indepth  discussion  of  this  subject). 

The  idea  of  a  defense  against  ballistic  missiles  is  not 
new.  In  the  early  1960s  we  demonstrated  a  capability  to 
intercept  an  ICBM  in  space,  and  were  well  underway  towards 
full  scale  development  of  the  Sentinel  and  Safeguard  anti- 
ballistic  missile  systems  when  we  signed  the  ABM  Treaty  with 
the  Soviets  in  May,  1972.  However,  between  then  and  March, 
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1983,  when  President  Ronald  Reagan  made  comprehensive  mis¬ 
sile  defense  an  explicit  national  goal,  very  little  serious 
consideration  was  given  to  the  idea  C47:23. 

Two  reasons  stand  out  for  this  hiatus;  policy  consider¬ 
ations  and  the  inability  of  technology  to  provide  (or 
promise  to  provide)  the  capability  for  a  reliable  ballistic 
missile  defense.  Former  Secretary  of  Defense  Robert 
MacNamara  summarized  the  policy  considerations  that  went 
into  our  country’s  decision  to  forego  a  defensive  capability 
in  1972  during  a  recent  television  documentary  on  the  SDI 
C2533.  He  said  that  back  then  we  did  not  have  the  capabil¬ 
ity  to  deploy  a  reliable  ABM  system  and  that  efforts  to 
secure  the  required  capability  would  be  destabilizing  to 
deterrence.  At  that  time  we  had  clear  strategic  offensive 
superiority  over  the  Soviets,  and  deterrence  was  based  on 
Soviet  awareness  of  this  capability  and  their  perception  of 
our  will  to  use  it  in  retaliation  for  any  strike  against  the 
U.S.  or  its  allies.  He  opposes  development,  or  even 
research  into  strategic  defensive  systems  today,  for  many 
of  the  same  reasons. 

During  the  Carter  administration,  very  little  direct 
effort  was  expended  on  SDI  related  concepts.  However, 
towards  the  later  part  of  Carter’s  term  in  office,  advocates 
of  space-based  ballistic  missile  defense  systems  became  more 
vocal  (Again,  Gen  Graham’s  High  Frontier  C105D  being  one  of 
the  more  famous  essays).  These  champions  of  “star  wars" 


C2531  weapons  pointed  out  that  technology,  and  the  promise 


o-F  future  technological  advances,  made  the  idea  feasible. 
President  Reagan,  as  pointed  out  earlier,  agreed  that  the 
concept  had  merit  and  directed  an  all-out  effort  to  explore 
the  options. 

Secretary  of  Defense  Caspar  Weinberger,  appearing  on 
the  same  documentary  as  MacNamara,  stated  that  the  capabil¬ 
ity  to  protect  against  an  ICBM  attack  Mould  represent  a 
stabilizing  influence  and  allow  us  to  draw  down  strategic 
offensive  forces.  Pursuing  the  R&D  necessary  to  prove  the 
feasibility  to  deploy  defensive  systems  in  space  would  not 
violate  the  ABM  Treaty.  However,  Weinberger  conceeded  that 
should  we  decide  to  deploy  the  system,  we  would  have  to 
renegotiate  or  abrogate  the  treaty  C2533. 

Weinberger  provided  additional  rationale  for  the  neces¬ 
sity  of  the  SDI  when  he  presented  the  Fiscal  Year  1985  Five 
Year  Defense  Plan  to  Congress.  He  cited  the  Soviets'  ad¬ 
vanced  ballistic  missile  defense  technologies,  the  fact  that 
they  alone  have  an  operational  ballistic  missile  defense, 
and  that  unilateral  breakthroughs  and  deployment  of  an 
advanced  system  would  "weaken  deterrence  and  threaten  U.S. 
security"  as  reasons  why  the  U.S.  should  pursue  SDI  related 
technologies.  "U.S.  research  efforts,"  he  said,  "will 
provide  a  necessary  and  vital  hedge  against  the  possibility 
of  such  a  one-sided  Soviet  deployment"  1256:841. 

Today  the  debate  continues,  despite  the  high  level 
support  from  President  Reagan.  Critics  of  SDI  cite  the 
destabilizing  effects  of  pursuing  a  reliable  defense  against 
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ballistic  missiles.  They  believe  that  the  Soviets  would 
launch  an  attack  before  we  could  ever  deploy  the  system  if 
they  thought  the  system  could  successfully  negate  their 
ballistic  missile  force.  The  point  of  this  discussion, 
however,  is  not  to  address  the  pros  and  cons  of  SDI,  but  to 
highlight  the  doctrinal  interactions  and  relationship  to  the 
R&D  process. 

We  can  see  how  elements  of  both  organizational  and 
environmental  doctrine  played,  and  continue  to  play,  major 
roles  in  the  debate.  Until  Reagan  directed  the  country  move 
forward  towards  exploring  the  feasibility  for  a  space-based 
ARM  system,  the  military  gave  it  very  little  consideration. 
From  an  organizational  doctrine  perspective,  the  military 
instrument  was  guided  by  the  policy  of  deterrence,  as  repre¬ 
sented  by  MAD  (Mutual  Assured  Destruction) .  Deterrence 
would  be  maintained  by  the  military  ensuring  it  had  the 
strategic  offensive  capability,  represented  in  the  strategic 
triad  (manned  bombers ,  land-based  ICBMs,  and  submarine 
launched  ballistic  missiles),  to  survive  a  first  strike  and 
retaliate  with  sufficient  force  to  assure  the  destruction  of 
the  aggressor's  homeland. 

On  the  other  hand,  advocates  of  SDI  argue  from  an 
environmental  doctrine  perspective,  extolling  the  advantages 
that  a  "real"  defense  against  ballistic  missiles  would 


provide.  R&D  efforts,  especially  in  the  areas  of  lasers  and 
particle  beams,  also  seemed  to  indicate  that  the  possibility 
is  real  that  such  systems  can  be  built  and  deployed  in  the 


near  future  C2533. 


These  discussions  point  out  that  considering  potential 
military  tasks,  and  the  R&D  necessary  to  support  them,  can 
be  viewed  from  an  environmental  doctrine  perspective.  This 
perspective  promotes  "free  thinking”  about  the  possible 
military  applications  available  within  an  operational  medium 
like  the  aerospace,  and  is  not  constrained  by  current  poli¬ 
cies,  or  strategies  and  tactics  (both  derived  from  organiza¬ 
tional  doctrine),  or  accepted  ways  for  doing  things.  We 
showed  how  application  of  environmental  doctrinal  thinking 
exploits  technology,  looking  for  new  ways  to  employ  techno¬ 
logical  breakthroughs  in  the  operational  medium.  At  the 
same  time,  technology  feeds  on  environmental  doctrine,  which 
often  serves  to  drive  new  requirements  for  R&D. 

We  propose  that  R&D  should  not  be  evaluated  solely  on 
its  linkage  to  operational  requirements  as  influenced  by 
organi zati onal  doctrine.  In  fact,  we  argue  that  by  incorpo¬ 
rating  environmental  doctrine  into  mission  area  analysis  we 
can  better  derive  future  operational  requirements  simply  by 
broadening  the  scope  of  tasks  considered.  This  is  in  fact 
what  the  MSSTP  process  does,  since  it  includes  concepts  for 
systems  we  are  currently  restricted  by  national  policy  from 
bui 1 di ng. 

When  we  present  our  hierarchy  we  argue  that  an  environ¬ 
mental  doctrine  perspective  also  allows  us  to  directly 
consider  two  important  R&D  needs  not  directly  supported  in  a 
mission  needs  hierarchy  such  as  that  used  by  the  MSSTP. 


These  are  “preserve  our  technological  superiority"  and 
“prevent  technological  surprise.”  Both  of  these  needs  are 
identified  in  published  Air  Force  doctrine  C6:4-ll,12;  8:93 
and  often  cited  in  the  literature  C5:34;  75:39;  112:71; 
115:62;  121:64;  161:443. 

Summarizing,  doctrine  is  intimately  linked  to  R&D.  As  a 
foundation  for  basic  beliefs  about  the  conduct  of  warfare, 
doctrine  defines  operational  requirements,  which,  in  turn, 
drive  the  R&D  effort  needed  to  meet  specific  performance 
parameters  to  accomplish  these  operational  requirements.  We 
defined  this  type  as  organizational  or  operational  doctrine, 
and  said  it  was  dynamic,  constrained  by  policies,  and 
limited  by  accepted  ways  of  doing  things. 

On  the  other  hand,  we  pointed  out  that  advances  in 
technology  can  actually  drive  the  development  of  doctrine, 
as  was  the  case  with  the  development  of  nuclear  weapons.  In 
other  cases  technological  advances  demonstrate  the  potential 
to  do  new  missions  in  support  of  national  security  objec¬ 
tives,  which  evolve  into  doctrine,  which,  in  turn,  challenge 
the  RS<D  community  to  develop  new  military  capabilities  to 
support  the  new  doctrine.  The  development  of  strategic 
bombing  is  a  specific  example.  These  examples  are  applica¬ 
tions  of  environmental  doctrine,  which  we  said  was  less 
influenced  by  current  thinking  and  policies,  and  more  "free¬ 
wheeling"  than  organizational  doctrine.  Proponents  of  en¬ 
vironmental  doctrine  are  heavily  influenced  by  technology 
and  its  application  in  supporting  potential  military  tasks 


in  the  operational  environment. 

We  also  pointed  out  some  drawbacks  with  identifying 
critical  technology  issues  through  mission  area  analyses 
(mission  needs  hierarchy).  It  is  difficult  to  gain  consen¬ 
sus  on  what  the  applicable  tasks  are  for  military  missions 
in  space.  Simply  stated,  mission  area  analyses  may  not 
successfully  identify  all  critical  technology  issues.  As 
pointed  out,  some  of  the  more  important  technologies  we  use 
today  were  not  surfaced  by  an  operational  needs  assess¬ 
ment.  We  showed  how  these  concerns  could  be  addressed 
within  the  context  of  environmental  doctrine  in  considering 
future  military  R?<D  requi rements. 


Summary  of  the  Environment. 

In  light  of  the  Soviet  Union’s  continued 
pressure  upon  the  qualitative  edge  and  the  long 
lead  time  required  to  develop  these  capabilities, 
we  have  no  choice  but  to  pursue  them  now.  We  must 
seek  the  revolutionary  technologies  of  the 
future — the  "big  wins"  on  the  technology  battle¬ 
field  that  will  provide  future  generations  of 
Americans  with  the  same  qualitative  edge  that  we 
have  enjoyed  1161:493. 

General  Robert  T.  Marsh 

We  discussed  six  factors  that  influence  the  environment 
in  which  military  space  R?<D  advocacy  must  operate.  Opera¬ 
tional  requirements  drive  the  R&D  process  and,  in  this 
respect,  space  technology  advocacy  must  give  this  interac¬ 
tion  strong  consideration.  Space  technology  efforts  should 


be  linked  to  military  task  requirements.  The  projected 


threat  drives  performance  parameters  to  which  the  R&D 


program  must  be  responsive.  If  the  capability  exists  to 
depict  and  analyze  R&D  e-f forts  on  the  basis  of  linkage  to 
operational  requirements,  then  the  space  R&D  advocate  should 
strongly  consider  using  such  a  framework  for  advocating  R&D 
programs.  Indeed,  the  foundation  for  relating  R&D  to  opera¬ 
tional  requirements  has  already  been  established  in  basic 
Air  Force  doctrine. 

On  the  other  hand,  we  showed  that  it  is  not  always 
possible  to  directly  link  R&D  efforts  to  operational  re¬ 
quirements.  We  must  consider  that  our  potential  adversaries 
could  develop  advanced  technologies  of  their  own  that  could 
significantly  alter  the  balance  of  power  and  present  a 
serious  threat  to  our  national  interests.  Our  technology 
base  and  R&D  effort  must  guard  against  the  possibility  of 
technological  surprise.  Likewise,  considering  doctrine  and 
the  physical  environment  of  space,  the  potential  for  devel¬ 
oping  significant  technological  advantages  is  unlimited  in 
the  space  medium.  We  showed  how  viewing  doctrine  from 
various  perspectives  can  aid  the  space  R?<D  advocate  in 
identifying  technology  issues  and  in  developing  a  space 
technology  advocacy  plan.  We  pointed  out  that  the  space  R&D 
advocate  must  consider  the  hedge  against  technological 
surprise  and  the  potential  for  technological  advantage  in 
his  advocacy  program  in  a  way  that  is  easily  understood  and 
accepted.  An  environmental  doctrine  approach  makes  this 
possible. 

Finally,  we  discussed  R2<D  in  the  context  of  national 


security  objectives  and  policies  and  resource  availability. 
These  environmental  -factors  actually  represent  constraints 
on  R&D.  Resources  will  always  be  limited,  and  -funding  o-f 
the  Air  Force  R&D  program  is  going  to  be  a  critical  issue 
for  some  time  to  come.  The  space  R&D  advocate  must  consider 
this  factor  in  his  advocacy  program  —  either  by  showing  how 
space— based  systems  are  more  economical  than  terrestrial— 
based  systems  or  by  clearly  demonstrating  that  the  strategic 
and  technical  utility  of  the  advocated  technology  makes  the 
required  expenditure  worthwhile.  While  AFM  1—6  states  that 
all  Air  Force  missions  can  be  accomplished  or  supported  from 
space,  national  p  >licy  restricts  the  military  instrument 
from  deploying  certain  types  of  systems  in  space  to  support 
national  security  objectives  C8:83.  Many  critics  of  space 
systems  refer  to  these  policy  constraints  as  reasons  why  R&D 
efforts  should  not  be  pursued  that  potentially  provide 
significant  military  advantages  to  the  United  States.  We 
have  discussed  the  impact  that  time  —  as  expressed  by  the 
length  of  time  it  takes  to  bring  a  technology  program  to 
fruition  in  a  weapons  system  —  has  on  supporting  opera¬ 
tional  requirements  with  our  RS<D  program.  We  cannot  afford 
to  be  limited  by  policy  considerations  in  advocating  space 
RS<D  programs  to  meet  known,  projected,  and  unknown  threats 
for  the  future.  The  threat  will  not  allow  recovery  from 
mistakes  made  twenty  years  in  the  past. 

In  the  next  chapter  we  present  our  hierarchy  and 
criteria  for  assessing  technology  issues.  Using  the 


V.  Proposed  Hierarchy  for  Space  R&D  Advocacy 

Introducti on 

We  concluded  Chapter  Three  with  a  diagram  of  the  MSSTP 
hierarchy  (-figure  5-1).  We  called  this  a  "mission  needs" 
tree  because  it  linked  technology  issues  through  various 
levels  to  DoD  missions.  This  hierarchy  was  intended  to 
show  the  connectivity  between  technology  issues  and  DoD 
mission  tasks. 

We  pointed  out  in  Chapter  Three  that  this  mission  needs 
structure  was  derived  through  mission  area  analysis  by 
evaluating  military  tasks  from  the  perspective  of  utility, 
projected  threat,  and  required  capabi 1 i ti es.  The  intent  of 
this  analysis  was  to  define  operational  requirements  for 
projected  tasks  and  to  identify  technology  requirements 
necessary  to  meet  these  requirements. 

We  also  noted  in  both  Chapters  Three  and  Four  some  of 
the  problems  with  the  MSSTP  hierarchical  structure  and 
process.  We  said  the  hierarchy  was  not  complete  since  it 
did  not  explicitly  show  all  the  linkages  between  military 
missions  and  national  needs.  Furthermore,  we  stated  that 
the  structure  may  not  surface  all  critical  space  technol¬ 
ogy  issues.  Specifically,  we  pointed  out  that  using 
concepts  to  help  identify  technology  issues  may  not  provide 
a  comprehensive  list.  Other  methods  exist  to  determine 
space  technology  issues.  These  alternative  methods  should 


be  considered. 


For  example, 


we  noted  that  if  performance 
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Figure  5—1.  MSSTP  &  TRUMP  Hierarchy 


parameters  were  completely  specified  for  all  tasks,  then  the 
difference  between  required  performance  capabilities  and 
projected  technology  to  support  these  capabilities  could 
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define  technology  issues.  However,  since  performance  param¬ 
eters  are  not  specified  for  all  tasks  in  the  MSSTP,  some 
technology  issues  may  go  undefined.  Finally,  we  suggested 
that  mission  area  analysis  does  not  identify  all  critical 
technology  issues  for  the  future  and  showed  examples  where 
important  technologies  in  use  today  by  the  military  were 
developed  completely  independent  of  an  operational  needs 
assessment. 

In  this  chapter  we  propose  a  more  comprehensive  hierar¬ 
chical  structure  to  model  the  R&D  process.  We  first  discuss 
the  benefits  of  organizing  complex  problems  in  hierarchies. 
This  discussion  introduces  our  proposed  hierarchy.  It 
incorporates  a  mission  needs  tree,  but  shows  linkages  from 
missions  to  national  interests  for  completeness.  We  have 
explicitly  included  environmental  doctrine  in  our  descrip¬ 
tions  of  missions  and  tasks,  so  there  are  some  differences 
between  our  mission  needs  tree  and  that  presented  in  the 
MSSTP. 

However,  the  mission  needs  branch  is  only  one  part  of 
our  hierarchy.  We  also  show  connectivity  from  technology 
issues  to  higher  level  needs  through  an  alternative  linkage 
—  the  scientific-technological  linkage.  We  believe  this 
linkage  provides  an  additional  method  for  identifying  and 
assessing  technology  issues,  many  of  which  would  not  surface 
through  mission  area  analysis  alone. 

We  next  discuss  three  criteria  we  derived  to  assess 
technology  issues.  These  criteria  are  intended  to  be  quali- 
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tative  measures  which  the  space  R&D  advocate  can  apply  to 
rank  order  a  list  of  technology  issues.  They  appear  at  the 
lower  end  of  our  hierarchy  to  show  their  linkage  to  technol¬ 
ogy  issues. 

Finally,  we  show  the  linkage  of  the  proposed  hierarchi¬ 
cal  structure  to  a  space  technology  advocacy  model  which 
considers  the  environmental  factors  we  discussed  in  Chapter 
Four.  This  serves  as  a  lead-in  to  the  discussion  of  the 
decision  support  implementation  of  our  methodology  covered 
in  Chapter  Six. 

Hierarchical  Ordering. 

Most  management  science  texts  describe  problem  defini¬ 
tion  as  one  of  the  most  difficult  and  yet  most  important 
steps  in  the  problem  solving  process  [44:8;  198:4;  206:63; 
218:246  1.  Among  the  difficulties  inherent  in  defining  and 
scoping  a  complex  problem  are  identifying  all  relevant  ele¬ 
ments  influencing  the  problem  and  recognizing  and/or  under¬ 
standing  the  relationships  between  elements.  It  is  not  a 
trivial  matter  to  establish  how  the  various  elements  "can  be 
communi cated,  organized  with  respect  to  structure,  and  eval¬ 
uated"  [206:631.  The  ultimate  goal  then  in  the  problem 
definition  stage  is  to  identify  all  relevant  criteria  (ele¬ 
ments)  and  organize  or  partition  the  problem  into  manageable 
parts  so  interactions  among  relevant  elements  clearly  stand 
out  [206:641. 


A  hierarchical  ordering  of  elements  is  a  logical  method— 


ology  for  organizing  and  displaying  the  various  elements  and 
their  relationships  relative  to  each  other.  A  hierarchy 
provides  an  easy  to  understand  -framework  for  describing  a 
problem  or  "process  that  fits  observations  of  the  real 
world"  1218:2461.  Ordering  elements  in  a  hierarchical 
structure  is  a  natural ,  human  tendency  when  attempting  to 
grasp  difficult  concepts.  We  all  try  to  "put  things  into 
perspective,"  "determine  priorities, "  and  logically  organize 
factors  by  degrees  of  importance.  Most  of  us  are  familiar 
with  Maslow's  hierarchy  of  needs  and  all  of  us  have  been 
exposed  to  organizational  charts,  chains  of  command,  and 
other  hierarchical  representations  of  real  world  processes 
or  structures. 

Hierarchies  are  especially  useful  for  defining  needs, 
desires,  and  higher  level  goals  and  objectives  which  are 
subjectively  described  and  cannot  be  directly  quantified  or 
measured.  These  higher  level  goals  and  objectives  can  then 
be  related  to  lower  level  elements  that  can  be  specifically 
quantified  and  used  as  performance  measures  for  the  less 
quantifiable  higher  level  elements  C2S8:17D.  Organizing 
elements  in  this  type  of  subordination  ordering  helps  the 
decision  maker  focus  on  critical  interactions  and  also 
provides  a  means  of  clustering  or  breaking  the  problem  into 
smaller,  more  manageable  parts  without  losing  connectivity 
between  elements.  In  general  a  hierarchical  structuring  of 
relevant  elements  bearing  on  a  problem  provides  a  clearly 
understood  framework.  With  this  structure,  the  problem  can 


be  analyzed  and  evaluated  -from  a  variety  of  perspectives  and 
methods. 

There  are  -few  "rules"  -for  hierarchies.  Elements  in  a 
hierarchy  are  loosely  defined  as  "criteria,"  and  include  all 
"attributes,  goals,  and  objectives  which  have  been  judged 
relevant  in  a  given  decision  situation  by  a  particular 
decision  maker"  £288:173.  Normally,  elements  at  the  same 
level  represent  "irreducibl y  simple  part(s)  o-f  a  system" 
£206: 133 . 

At  the  top  o-f  the  hierarchy  are  the  "axiological  objec¬ 
tives"  that  represent  the  needs,  higher  level  goals,  and 
value  system  o-f  the  decision  maker  and/or  his  environment 
£206:633.  At  the  bottom  are  objective  measures,  performance 
parameters,  or  descriptors  that  can  be  quantified  (surrogate 
criteria)  and  thus  used  as  measures  to  determine  the  degree 
of  achievement  for  realizing  higher  level,  more  abstract 
goals.  In  between  are  various  levels  of  goals,  objectives, 
and  attributes  that  further  describe  the  process  being 
modeled.  They  are  linked,  both  from  above  and  below  on  the 
hierarchy,  by  the  transitive  relations  of  "how"  and/or  "why" 
to  show  clear  connectivity.  These  may  be  causal  relation¬ 
ships  where  satisfaction  of  higher  level  elements  depends 
first  upon  satisfying  lower  level  objectives.  They  may  also 
be  relational  linkages  where  satisfaction  of  a  lower  level 
element  contributes  to  the  actualization  of  higher  level 
elements. 

Ideally,  elements  at  the  same  level  should  be  mutually 


exclusive  (independent  o-f  one  another)  and  collectively 
exhaustive  (together  they  cover  all  contingencies).  In  most 
complex,  real  world  problems  this  is  not  possible  due  to  the 
interdependency  o-f  elements  and  an  inability  to  clearly 
break  out  and  clump  all  elements  according  to  neatly  bounded 
and  narrowly  defined  standards.  Schoderbek,  et.  al .  C213D 
state  that  "absolute  subordination  among  parts  does  not 
exist.  In  fact,  the  division  between  absolute  'parts'  and 
'wholes’  is  arbitrary,  if  not  meaningless"  1213:264—265 ]. 

Despite  these  difficulties,  hierarchical  structures 
offer  many  advantages.  They  help  the  decision  maker  scope 
the  problem,  graphically  describe  perceptions  of  real  world 
processes,  determine  relative  degrees  of  importance  between 
various  elements,  and  break  complex  problems  down  into  more 
manageable  parts.  They  provide  "an  organized  but  complex 
framework  that  allows  for  interaction  and  interdependence 
among  factors"  and  enable  us  to  "think  about  them  (factors) 
in  a  simple  way"  C198:43.  Hierarchies,  in  and  of  them¬ 
selves,  are  simple.  They  represent  simplified  representa¬ 
tions  of  difficult  conceptual  and  contextual  relationships. 
It  is  the  identifying  and  ordering  of  all  relevant  elements 
that  can  be  most  demanding.  However,  taking  the  time  to 
clearly  structure  relevant  elements  is  a  necessary  and 
worthwhile  first  step  in  defining  and  scoping  complex  prob¬ 
lems.  The  resulting  structure  then  provides  a  reasonable 
framework  for  subsequent  analysis. 


As  discussed  in  Chapter  Four,  the  R&D  environment  is  not 
easily  understood  nor  described.  A  hierarchical  -framework 
can  provide  a  pictorial  representation  o-f  the  space  RScD 
environment  as  it  relates  to  Air  Force  missions,  DoD  mis¬ 
sions,  national  policies,  national  security  objectives,  and 
national  interests.  We  introduced  this  chapter  with  a  sum¬ 
mary  o-f  the  hierarchical  structure  discussed  in  the  MSSTP, 
and  reiterated  some  of  its  shortfalls.  In  this  section  we 
present  an  alternative  hierarchical  structure  that  we  be¬ 
lieve  represents  a  more  comprehensive  "picture"  of  the  ele¬ 
ments  and  their  relative  ordering  with  respect  to  each 
other.  The  hierarchy  we  develop  is  shown  in  Figure  5-2. 

We  make  three  major  changes  to  the  MSSTP  hierarchy. 
The  first  is  explicitly  describing  the  linkages  from 
national  interests  at  the  top  down  through  missions,  which 
was  not  done  in  the  MSSTP.  Aside  from  this,  the  left  side 
of  our  hierarchy  appears  very  similar  to  the  "mission  needs" 
hierarchy  of  the  MSSTP.  However,  since  we  incorporate 
environmental  doctrine  in  deriving  responsibi 1 i ties, 
missions,  and  tasks,  descriptions  of  these  elements  will 
vary  somewhat  from  those  in  the  MSSTP  (see  Appendix  B) . 

The  second  change  is  more  significant.  Here  we  show 
linkage  between  technology  issues  and  the  scientific- 
technological  instrument  of  national  policy.  As  developed 
in  our  discussion  of  the  relationship  between  R&D  and 
doctrine,  doctrine  both  drives  and  is  driven  by  RScD.  In 
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Figure  5-2.  Space  R&D  Advocacy  Hierarchy 


particular,  environmental  doctrine  seems  to  have  a  close 
interaction  with  R&D.  At  times  environmental  doctrine  is 
proposed  on  the  basis  o-f  new  technology,  while  at  other 
times  environmental  doctrine  will  challenge  the  R&D  commu¬ 
nity  to  provide  new  capabilities  called  -for  by  the  doctrine. 


These  interactions  are  not  adequately  represented  -from  a 


mission  area  analysis  alone.  The  direct  linkage  between 
technology  issues  and  the  scientific-technological  instru¬ 
ment  is  designed  to  provide  an  alternative  perspective  for 
evaluating  space  technology  issues  that  may  not  readily 
connect  through  the  mission  needs  branch  of  the  hierarchy. 

Finally,  the  third  change  is  that  we  identify  three 
criteria  for  evaluating  the  various  technology  issues’ 
contributions  to  the  hierarchical  branches.  A  decision 
maker’s  subjective  preferences  can  be  elicited  with  respect 
to  how  technology  issues  compare  using  these  criteria.  The 
hierarchy  linking  technology  issues  to  higher  level  needs  is 
the  conceptual  and  contextual  framework  within  which  these 
comparisons  can  be  made.  We  also  discuss  the  dynamic  nature 
of  these  criteria  to  show  that  their  relative  importance 
could  change  with  respect  to  time.  The  criteria  we  intro¬ 
duce  are:  1)  supports  known  and  projected  mission  require¬ 
ments  and  tasks;  2)  broad  application  and/or  revol uti onary 
application;  and  3)  hedge  against  technological  surprise  and 
uncertai nty . 

In  the  following  sections  we  describe  the  various 
levels  of  our  hierarchy.  We  first  cover  the  levels  at  and 
above  the  military  and  scientific— technological  instruments 
of  national  policy  and  describe  the  applicability  of  both 
instruments  to  these  higher  level  elements.  We  then  address 
our  mission  needs  hierarchy  and  emphasise  the  differences 
and  the  similarities  to  the  MSSTP  structure.  Next,  we 
describe  the  technology  issue  linkage  to  the  scientific- 


technol ogi cal  instrument.  In  both  cases  we  discuss  how 
technology  issues  are  or  can  be  generated  from  this  model. 
Finally,  we  discuss  the  three  criteria  for  evaluating  tech¬ 
nology  issues  and  provide  rationale  for  selecting  these 
three. 

Definitions  and  descriptions  of  the  hierarchical  levels 
are  generally  aggregates  derived  from  Air  Force  policy, 
published  doctrine,  the  MSSTP,  our  own  thoughts,  and  a 
variety  of  other  sources.  We  point  out  here  that  the  intent 
is  to  justify  the  various  levels  of  the  hierarchy  and  not 
the  individual  elements  that  comprise  each  level.  While  we 
include  descriptions  of  some  of  the  elements  for  illustra¬ 
tive  purposes,  we  do  not  intend  to  defend  the  elements 
shown  as  a  comprehensive  or  mutually  exclusive  list. 

Upper  Levels  of  the  Hierarchy.  In  this  section  we 
describe  the  levels  and  interactions  between  the  higher 
levels  of  the  hierarchy.  These  levels  are  national  inter¬ 
ests,  national  objectives,  national  policies,  and  instru¬ 
ments  of  national  power. 

National  Interests.  National  interests  are 
broadly  stated  representations  of  basic  national  values  and 
beliefs.  They  are  fundamental  to  national  survival  and  the 
preservation  of  our  way  of  life  with  our  value  systems 
intact.  The  elements  include  preservation  of  national  sur¬ 
vival,  territorial  integrity,  economic  well-being,  and 
favorable  world  order.  While  perceptions  may  differ  on  how 
best  to  maintain  national  interests.  these  elements  are  not 


prone  to  change  over  time.  National  interests  drive  broadly 
stated  objectives  that  support  national  interests. 

National  Objectives.  National  objectives  provide 
general  guidance  on  how  to  maintain  or  achieve  national 
interests.  Elements  include  security,  economic,  social,  and 
technological  objectives.  Our  primary  national  security 
objective  is  to  preserve  the  United  States  as  a  -free  nation 
with  its  -fundamental  institutions  and  values  intact. 
Specific  elements  of  this  objective  include  ensuring  the 
capability  to  deter  attacks,  defeat  attacks,  prevent  coer¬ 
cion,  limit  Soviet  advantages,  assure  access  to  and  through 
the  open  seas  and  space,  protect  economic  interests,  contain 
Soviet  expansionism,  discourage  subversion  and  terrorism, 
and  foster  long-term  changes  favorable  to  the  United  States. 

Likewise,  national  technol ogi cal  objectives  support 
national  interests.  The  primary  technological  objective  is 
to  maintain  the  superiority  of  American  technology  necessary 
to  support  national  interests.  Elements  include:  maintain 
technological  edge  in  defense  systems,  maintain  the  suprem¬ 
acy  of  American  technology  in  world  markets,  and  pursue  new 
technologies  that  expand  the  boundaries  of  science  and  tech— 
nol ogy. 

Space  objectives  are  incorporated  under  national 
security  objectives  and  technological  objectives.  Elements 
include:  maintain  US  space  leadership  and  cooperate  with 
other  nations  in  maintaining  freedom  of  space  for  the 
welfare  and  security  of  mankind. 


National  objectives  provide  the  -focus  for  and  shape 
national  policies. 

National  Policies.  National  policies  are  broadly 
stated  but  are  more  specific  guidelines  to  achieve  national 
security  and  other  national  objectives.  For  example, 
national  defense  policies  represent  a  "broad  course  of 
action  adopted  by  the  US  government  in  pursuit  of  our 
national  security  objectives'*  C71.  Policies  reflect  the 
decisions  of  the  national  leadership  that  support  national 
objectives.  These  policies  are  constrained  by  the  Constitu¬ 
tion,  federal  and  international  law,  treaties,  mutual 
defense  agreements,  and  other  external  factors  that  can 
impact  the  decision  making  process.  Policies  are  more  dy¬ 
namic  in  that  they  reflect  the  current  position  and  beliefs 
of  the  national  leadership  and  can  vary  with  changes  in  the 
national  leadership  and  the  international  environment. 

For  example,  space  policy  is  currently  constrained  by 
international  law  and  treaty  obligations.  The  U.S.  is  pro¬ 
hibited  by  international  law  and  treaties  from  testing 
nuclear  weapons  and  deploying  weapons  of  mass  destruction  in 
space.  U.S.  obligations  to  the  ABM  Treaty  preclude  the 
development,  testing,  and  deployment  of  space-based  ABM 
systems  C210:41. 

National  space  policy  guides  the  civil  and  military 
sectors  toward  national  objectives.  Examples  of  national 
space  policy  that  relate  to  national  technological  objec¬ 
tives  are:  preserve  the  US  preeminence  in  critical  space 


activities  to  enable  continued  exploitation  and  exploration 
of  space?  continue  to  explore  the  requirements,  operational 
concepts,  and  technology  associated  with  permanent  space 
facilities;  conduct  appropriate  research  and  experi mentati on 
in  advanced  technology  and  systems  to  provide  a  basis  for 
future  civil  applications;  and  develop,  manage,  and  operate 
a  Space  Transportati on  System  C8:33.  Space  policies  that 
support  national  security  objectives  include:  pursue  surviv- 
able  and  endurable  space  systems  that  support  national 
security  objectives;  develop  an  anti -satel 1 i te  capability  to 
deter  threats  to  US  space  assets;  and  "develop  and  maintain 
an  integrated  attack  warning,  notification,  veri f i cation, 
and  contingency  reaction  capability  which  can  effectively 
detect  and  react  to  threats  to  United  States  space  systems" 
C8:3 1. 

National  policies  are  accomplished  or  pursued  by 
instruments  of  national  power. 

Instruments  of  National  Power.  Policies  are 
carried  out  through  the  use  of  instruments  of  national 
power.  These  instruments  are  political,  economic,  psycho¬ 
social,  sci enti f i c-technol ogi cal ,  and  military.  The  ability 
to  pursue  national  policies  is  directly  dependent  on  the 
strengths  and  capabilities  of  the  instruments  of  national 
power.  Here  our  specific  concern  is  with  the  military  and 
scientif ic-technological  instruments  of  national  power. 

The  military  instrument  must  be  strong  enough  to  sup¬ 
port  national  security  objectives  as  specified  by  national 
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policy.  The  national  leadership  determines  if,  when,  and 
how  the  military  instrument  is  applied,  and  how  it  is  to  be 
used  in  concert  with  other  instruments  of  national  power. 
Since  our  primary  purpose  is  to  link  space  RS<D  requirements 
to  national  needs,  our  focus  is  on  how  R&D  can  support  the 
military  instrument.  Therefore,  wherever  official  guidance 
suggests  that  RS<D  efforts  support  operational  requi rements, 
both  current  and  projected,  the  R&D  issues  are  indeed  linked 
to  national  needs  through  the  military  instrument. 

On  the  other  hand,  where  guidance  relates  to  main¬ 
taining  technological  superiority  (broadly  stated,  with  no 
direct  connectivity  to  existing  or  planned  systems,  capabil¬ 
ities,  or  military  tasks)  and  hedging  against  technological 
surprise,  linkage  of  R?<D  issues  to  national  interests  are 
through  the  scientific-technological  instrument  of  national 
power.  This  instrument  is  not  as  well-defined  as  the  mili¬ 
tary  instrument.  However,  we  describe  it  as  the  industrial 
and  technology  base  represented  by  American  corporations, 
private  and  governmental  research  activities,  and  educa¬ 
tional  institutions  which  provide  the  skilled  people, 
resources,  and  innovations  necessary  to  maintain  a  techno¬ 
logical  edge  C&8;  751. 

Thus  far  we  have  described  the  higher  levels  of  our 
hierarchy  which  represents  the  framework  to  identify  or 
consider  space  technology  issues.  National  issues  drive 
national  objectives,  which  shape  national  policies.  Nation¬ 
al  policies  are  pursued  through  instruments  of  national  of 
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(hedge  on  tech  uncertainty) 


Figure  5-3.  Hierarchical  Structure,  Upper  Levels 


power.  These  rel ati onshi ps  are  shown  in  Figure  5—3. 

The  specific  connectivity  of  technology  issues  to  the 
military  and  sci enti f i c— technol ogi cal  instruments  of 
national  power  has  not  yet  been  shown.  We  describe  these 
two  branches  in  the  sections  that  follow. 

"Mission  Needs"  Hierarchy.  The  mission  needs  hierarchy 
allows  technology  issues  that  relate  to  military  performance 


requirements  to  be  linked  to  national 


interests. 


Thi  s 


proposed  mission  needs  hierarchy  is  very  similar  to  the  one 
described  in  the  MSSTP  and  TRUMP.  However,  we  have  incor¬ 
porated  environmental  doctrine  in  the  descriptions  of  the 
various  levels  and  elements  o-f  this  hierarchy.  We  believe 
this  provides  the  decision  maker  greater  -flexibility  in 
considering  potential  military  tasks  that  could  be  accom¬ 
plished  in  space,  but  may  currently  be  prohibited  or 
restricted  by  policy.  As  discussed  in  Chapter  Four,  the 
planning  horizon  -for  R&D  extends  well  into  the  future.  We 
can  better  forecast  future  military  requirements  in  the 
context  of  environmental  doctrine,  which  is  relatively 
unconstrained  by  current  thinking  or  policy. 

The  following  discussion  is  an  abbreviated  description 
of  the  levels  through  which  technology  issues  can  be  linked 
to  the  military  instrument  and  thus  to  national  interests. 
We  expand  this  discussion  in  Appendix  G,  which  provides  the 
rationale  for  our  recommended  ordering  and  descriptions  of 
the  various  levels  and  elements  in  the  hierarchy.  For  the 
sake  of  brevity  they  are  not  addressed  here.  Our  focus  is 
on  Air  Force  requirements,  since  the  Air  Force  is  the  DoD 
Executive  Agent  for  military  activities  in  space.  However, 
our  treatment  of  missions  and  responsibilities  is  broadly 
scoped  to  include  all  DoD  space-related  requirements  in  this 
hierarchical  model. 


Fundamental  Military  Objective.  The  military 


instrument  of  national  power  allows  the  national  leadership 


to  pursue  national  policies  in  the  context  of  military 
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operations.  The  fundamental  military  objective  is  to 
conduct  warfare  to  resolve  conflict  at  all  levels  on  terms 
favorable  to  the  United  States  and  its  allies.  Implicit  in 
this  objective  is  that  the  military  instrument  must  be 
capable  enough  to  deter  aggressive  acts  detrimental  to  our 
national  interests.  The  military  must  be  sufficiently 
strong  and  flexible  to  fight  and  win  at  the  level  of  inten¬ 
sity  necessary  to  achieve  US  objectives. 

ftir  Force  Responsibilities.  Each  of  the  Armed 
Services  has  general  functional  responsibi 1 i tes  that  are 
assigned  by  law  and  policy  to  support  the  fundamental  mili¬ 
tary  objective.  Air  Force  responsibilities  are  derived  from 
the  National  Security  Act  of  1947,  the  National  Aeronautics 
and  Space  Act  of  195S,  JCS  Publication  2,  "JCS  Unified 
Action,"  and  DoD  Directive  5100.1,  "Functions  Paper"  (1958). 
The  major  role  of  the  US  Air  Force  is  to  conduct  aerospace 
operations  in  support  of  the  national  interests  of  the 
United  States. 

We  generated  seven  Air  Force  functional  responsibili¬ 
ties  by  rearranging  responsibilities  listed  in  AFM  1-1 
(1979)  and  changing  descriptions  to  include  the  space  medium 
as  part  of  the  operational  environment.  These  are: 

1.  Provide  forces  to  conduct  prompt  and  sustained 
combat  operations  in  the  aerospace  to  defeat  enemy 
air  and  space  power; 

2.  Provide  forces  for  strategic  aerospace  warfare; 

3.  Provide  adequate,  timely,  and  reliable  intelli¬ 
gence,  surveillance,  reconnaissance,  and  aerospace 
photography ; 
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4.  Provide  the  capability  to  interdict  enemy 
targets? 

5.  Provide  forces  for  aerospace  defense  of  the 
United  States  and  allied  territories  and 
resources? 

6.  Formulate  doctrine  and  procedures  for  the 
organizing,  equipping,  training  and  employment  of 
Air  Force  farces? 

7.  Coordinate  with  and  support  other  Services  in 
joint  operations  and  strategy. 

Aerospace  Missions.  Functional  responsibilities 
are  supported  by  various  aerospace  missions.  Until  re¬ 
cently,  published  Air  Force  doctrine  C63  listed  nine  primary 
and  one  collateral  missions  for  the  Air  Force.  Space  Opera¬ 
tions  was  defined  as  one  of  these  missions,  with  the 
following  three  categories:  space  support,  force  enhance¬ 
ment,  and  space  defense.  To  be  consistent  with  our 
description  of  environmental  doctrine,  which  asserts  that 
space  is  part  of  the  operational  environment  in  which  Air 
Force  missions  are  conducted  or  supported,  we  developed  an 
alternative  list  of  eight  missions.  These  are:  strategic 
aerospace  offense?  strategic  aerospace  defense?  aerospace 
lift  support  (we  included  space  support,  to  include  launch 
and  recovery  of  space  payloads  in  this  category)?  close 
aerospace  support?  aerospace  interdiction?  counteraerospace 
operations  (which  includes  offensive  and  defensive  counter- 
aerospace  missions  and  defense  suppression)?  special  opera¬ 
tions?  and  surveillance  and  reconnai ssance  (tactical  and 
strategic) . 


In  Appendix  G  we  define  each  of  these  missions  and  show 


how  they  differ  -from  previously  published  Air  Force  doc¬ 
trine.  We  note  that  Air  Force  doctrine  has  recently  been 
revised  (the  draft  to  AFM  1  —  1  C73  has  been  approved)  and  our 
mission  descriptions  are  in  consonance  with  this  new  doc¬ 
trine.  In  addition  to  the  changes  already  discussed,  we 
deleted  "-force  enhancement  “  as  a  sub-mission  category 
(previously  listed  under  space  operations).  Our  rationale 
was  that  space  systems  (or  any  other  for  that  matter)  could 
fully  or  partially  satisfy  mission  requirements.  If  they 
partially  satisfy  requirements,  then  they  may  be  perceived 
as  "enhancements",  but  in  reality  directly  contribute  to 
mission  accomplishment. 

Mission  Tasks.  Tasks  are  defined  as  those  spe¬ 
cific  capabilities  required  to  accomplish  missions.  Our 
task  list  is  similar  to  the  26  tasks  derived  in  the  MSSTP 
C170],  although  we  have  deleted  force  enhancement  type  tasks 
such  as  "ballistic  missile  accuracy  enhancement."  We  also 
restructured  tasks  to  show  functional  relationships.  For 
example,  we  show  as  one  task  category  "detect,  identify, 
track,  intercept,  and  destroy,"  and  list  specific  types  of 
targets:  ballistic  mi ssi 1 es/SLBMs,  air  vehicles,  surface 
(terrestrial  based)  targets,  and  space  vehicles  and  plat¬ 
forms.  The  MSSTP  breaks  these  out  differently.  For 
example,  task  #1  in  the  MSSTP  is  "warning  of  ballistic 
missile  attack  on  CONUS."  Our  complete  list  of  tasks  is 
discussed  in  Appendix  G. 

We  emphasize  here  that  any  task  breakout  is  for  the 


most  part  arbitrary  and  subject  to  several  considerations. 
It  is  difficult,  if  not  impossible  to  completely  distinguish 


between  elements  or  even  levels  in  the  hierarchy.  As  we 
pointed  out  in  our  general  discussion  of  hierarchical  struc¬ 
tures,  most  real  world  situations  are  complex.  At  best,  the 
hierarchy  can  only  represent  a  decision  maker’s  perception 
of  real  world  orderings  C2133.  The  difficulty  in  discrimi¬ 
nating  between  tasks,  between  certain  tasks  and  missions,  or 
even  tasks  and  functions  <the  next  level  in  the  hierarchy) 
is  highlighted  in  the  following  example. 

Consider  the  task  "detect,  identify,  track,  intercept, 
and  destroy  manned  bombers  attacking  the  United  States."  In 
actuality,  this  is  one  of  the  primary  missions  of  the  North 
American  Defense  Command.  And  yet  the  same  task,  slightly 
reworded  to  "detect,  identify,  track,  intercept,  and  destroy 
enemy  fighter  aircraft"  is  clearly  a  task  in  support  of  the 
counter aerospace  mission. 

Our  point  is  that  detailed  discriminations  between 
missions,  tasks,  and  functions  is  dependent  on  the  scope  and 
nature  of  the  situation.  The  decision  maker  assessing  the 
problem  determines  the  scope  and  parameters  in  his  evalua¬ 
tion.  The  hierarchy  is  still  valid  as  a  conceptual  frame¬ 
work  to  structure  and  evaluate  the  problem.  However,  the 
specific  elements  may  "move"  up  or  down  levels  on  the  hier¬ 
archy  depending  on  the  scope  of  the  problem. 

Task  Requirements.  Task  requirements  are  the 
basic  building  blocks  or  specific  capabilities  that  allow  a 


task  to  be  accomplished  at  some  required  performance  level. 
They  help  the  decision  maker  further  breakout  task  require¬ 
ments  in  terms  of  functional  areas.  Qur  list  of  task 
requirements  corresponds  closely  with  the  fifteen  military 
"functions"  discussed  in  the  MSSTP.  Again,  these  elements 
are  to  some  extent  arbitrary,  and  depend  on  the  scope  and 
nature  of  the  problem  under  consideration. 

Task  requirements  are  specified  in  terms  of  various 
performance  parameters.  We  use  the  same  six  described  in 
the  MSSTP  (area  of  coverage,  capacity,  timeliness,  quality, 
survivability,  and  availability).  These  qualitative  parame¬ 
ters  help  the  decision  maker  consider  the  performance  levels 
required  of  each  task  requirement. 

Technology  Issues.  Assuming  that  detailed  per¬ 
formance  levels  can  be  specified  for  all  required  military 
tasks,  then  these  required  performance  levels  can  be  matched 
against  available  technology.  If  existing  technology  will 
not  provide  required  performance,  then  a  technology  issue  is 
defined  and  quantified  by  the  difference  between  required 
and  available  performance  levels  necessary  to  meet  task 
requi rements. 

Technology  issues  can  also  be  generated  by  system  con¬ 
cept  proposals,  "paper  studies,"  expert  panels,  experimenta¬ 
tion,  outside  sources  (industry,  independent  researchers, 
etc),  and  DoD  or  Air  Force  planners  and  operations 


personnel,  either  apart  from  or  in  conjunction  with  mission 
area  analyses.  Mission  area  analyses  could  be  easily  struc- 


tured  using  the  hierarchy  we  have  just  described.  And  if 
tasks  and  task  requirements  were  adequately  specified,  the 
performance  shortfalls  themselves  provide  the  best  defini¬ 
tion  for  the  technology  issues  that  must  be  resolved  to 
support  identified  requirements. 

We  emphasize  that  our  hierarchy  does  not  depend  on 
space  system  concept  studies  to  generate  space  technology 
issues.  Concepts  are  only  one  of  many  ways  in  which  tech¬ 
nology  issues  can  be  identified.  We  also  point  out  that 
this  recommended  structure  does  not  guarantee  that  all  tech¬ 
nology  issues  necessary  to  support  military  requirements 
will  be  identified.  However,  we  believe  it  is  sufficiently 
comprehensive  to  focus  attention  on  the  critical  issues 
necessary  to  provide  the  broad  technology  base  to  meet 
projected  military  space  requirements. 

A  major  limitation  of  this  or  any  "mission  needs" 
hierarchy  is  that  it  presumes  all  essential  military  tasks 
and  requirements  to  meet  future  needs  can  be  specified.  In 
Chapter  Four  we  pointed  out  that  there  are  inherent  problems 
with  defining  operational  requirements  for  the  future. 
Organizational  doctrine,  based  on  current,  accepted  ways  of 
doing  things,  limits  our  perspective  and  constrains  us  from 
considering  revol uti onary  concepts  or  ideas.  While  we  have 
attempted  to  counter  this  somewhat  by  incorporating  environ¬ 
mental  doctrine  into  our  mission  needs  hierarchy,  we 
recognize  that  some  potentially  critical  technology  issues 
may  still  not  weight  very  high  when  evaluated  against  a 
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mission  needs  hierarchy 


In  part  because  of  this. 


we  add 


the  linkage  o-f  technology  issues  to  the  scientif ic-techno- 
logical  instrument  of  national  power,  discussed  in  the  next 
section. 

Linkage  of  Space  Technology  Issues  to  the  Scientific- 
Technological  Instrument.  An  alternative  way  to  consider 
technology  issues  is  to  relate  them  directly  to  their  rela¬ 
tive  support  of  the  scientif ic-technological  instrument  of 
national  power.  This  provides  a  decision  maker  an  alterna¬ 
tive  approach  to  considering  the  potential  importance  of 
pursuing  certain  technology  programs  that  may  not  rank  very 
high  when  evaluated  against  a  mission  needs  perspective. 

As  pointed  out  in  Chapter  Four,  some  of  the  most  useful 
and  critical  technologies  used  by  the  military  today  were 
not  identified  by  mission  area  analyses.  We  pointed  out 
that  the  airplane,  the  jet  engine,  communications  satellite, 
and  semi -conductor  technologies,  among  others,  were  created 
outside  the  military  environment.  Even  the  inventor  of  the 
laser  had  no  idea  that  his  invention  would  lead  to  the  broad 
range  of  applications  it  has  contributed  to  today.  Charles 
Townes  said  of  his  invention  "as  it  turned  out,  I  was  much 
too  conservative;  the  field  has  developed  far  beyond  my 
imagination  and  along  paths  I  could  not  have  foreseen  at  the 
time"  1254:1531.  If  past  history  is  any  indicator,  then  it 
is  likely  that  many  of  the  military  technologies  of  the 
future  may  be  similarly  derived. 

We  hypothesize  that  this  linkage  provides  an  ideal 


perspective  to  consider  technologies  that,  for  one  reason  or 
another,  may  be  discounted  in  a  mission  needs  analysis. 
Environmental  doctr i nal i sts,  purporting  new  military  capa¬ 
bilities  and  tasks  that  run  counter  to  current  thinking,  may 
generate  technology  requirements  that  cannot,  for  political 
reasons,  be  considered  in  a  mission  needs  context.  Tech¬ 
nologies  that  cannot  be  directly  linked  to  existing  military 
needs  but,  in  the  mind  of  the  decision  maker,  could  provide 
tremendous  benefits  or  hedge  against  technological  surprise, 
could  be  considered  by  evaluating  their  contribution  to  the 
broader  scientific— technological  instrument  of  national 
power . 

Additionally,  sometimes  it  is  worthwhile  to  pursue 
research  for  research's  sake.  In  doing  so,  we  gradually 
reduce  the  uncertainty  surrounding  previously  unexplored 
mysteries.  From  basic  research,  with  no  particular  applied 
technol ogi cal  goal  in  mind,  surface  some  of  the  more  spec¬ 
tacular  discoveries  which  are  later  incorporated  into 
military  technological  applications.  Basic  research  in 
quantum  physics  led  directly  to  the  development  of  the 
atomic  bomb,  an  event  clearly  unforeseen  by  the  early  theo¬ 
reticians,  who  had  difficulty  even  accepting  the  results  of 
their  findings,  they  were  so  revolutionary.  The  space  tech¬ 
nology  advocate,  aware  of  basic  research  proposals,  may  want 
to  consider  these  in  his  advocacy  position.  The  scientific- 
technological  linkage  clearly  allows  him  to  do  so. 

In  general,  while  it  is  extremely  difficult  to  do  any 
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more  than  qualitatively  and  sometimes  vaguely  describe  these 


potential  breakthroughs,  hedges  against  technol ogi cal 
uncertainty  or  technological  surprise,  it  is  important  that 
the  decision  maker  consider  them.  For  this  reason,  we  show 
the  linkage  of  technology  issues  to  the  scientific- 
technological  instrument. 

Additionally,  the  space  technology  advocate  may  want 
to  consider  potential  benefits  of  military  related  space  R&D 
to  other  national  needs.  On  the  other  hand,  he  may  also 
want  to  speculate  on  potential  military  applications  for  R&D 
programs  underway  in  the  private  sector  designed  to  meet 
commericial  needs.  This  linkage  provides  a  means  for  doing 
both. 

Technology  issues  linked  to  the  scientific-technolog¬ 
ical  instrument  of  national  power  can  be  generated  in  a 
number  of  ways.  However,  they  most  likely  will  come  from 
research  proposals,  "paper  studies,"  or  far-thinking  theore¬ 
ticians. 

Determining  the  Strategic  and  Technical  Utility  of  Space 
Technology  Issues 

Up  to  this  point  we  have  described  a  hierarchical  model 
which  forms  a  conceptual  and  contextual  framework  which  the 
space  technology  advocate  can  use  to  link  space  technology 
issues  to  national  interests.  However,  effective  space 
technology  advocacy  relies  heavily  on  the  willingness  and 
ability  of  the  space  technology  advocate  to  undertake  an 
analysis  of  the  strategic  and  technical  merits  of  space 
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technology  issues. 


We  have  developed  criteria  that  we  feel 


will  focus  this  analysis.  The  criteria  can  be  applied  to 
gain  insight  into  the  relative  importance  of  technology 
i ssues. 

The  development  in  the  following  discussion  is  broken 
into  two  sections.  The  first  section  is  a  discussion  of  the 
time  frame  or  planning  horizon  for  technology  issue  assess¬ 
ment.  The  second  section  deals  with  the  criteria  for 
evaluating  the  strategic  and  technical  utility  of  space 
technology  issues.  We  hypothesize  that  the  relative  impor¬ 
tance  of  the  criteria  in  this  category  will  change  depending 
upon  the  time  frame.  In  other  words,  the  planning  horizon 
dominates  the  strategic  and  technical  utility  criteria. 

The  Planning  Horizon.  A  logical  breakout  to  address 
this  "time  dependency"  is  to  separate  technology  issues  by 
technology  due  date.  This  technology  due  date  can  fall  into 
four  main  time  categories:  present— term,  near— term,  mid¬ 
term,  and  far-term.  The  strategic  and  technical  utility 
criteria  should  not  change  in  any  given  time  frame.  How¬ 
ever,  the  weighting  of  each  of  these  criteria  should  and 
probably  will  change  based  upon  the  time  reference  for  the 
specific  technology  issues  at  hand. 


We  suggest  the 

foil  owing 

time 

di vi si ons. 

The 

present 

-term  represents 

technol ogy 

due 

dates  within 

the 

current 

five-year  plan. 

We  assume 

that 

technol ogy 

i ssues 

within 

this  time  frame 

are  already 

being 

addressed 

by 

the 

appropriate  advocates  (example;  System  Program  Offices). 


The  near-term  is  defined  as  technology  due  dates  that  are 
between  5  and  10  years  from  the  current  time.  The  mid-term 
would  then  be  the  next  5  year  period.  The  far-term  horizon 
represents  technology  due  dates  greater  than  15  years  from 
the  current  date.  For  the  year  1985  the  present-term  is 
1985—1990,  the  near-term  is  1991—1995,  mid-term  is  1996— 
2000,  and  the  far-term  is  2001  and  beyond. 

We  note  that  near-term  planning  is  more  concrete  than 
far— term  planning.  Mid-term  planning  naturally  falls  some¬ 
where  in-between.  Basically,  the  near-term  deals  with 
specific,  possibly  well-defined  systems  whereas  the  far— term 
may  deal  only  in  hypothetical  system  concepts.  The  near 
term  is  characteri zed  by  actual  hardware  with  heavy  emphasis 
on  development  whereas  the  far  term  can  be  characterized  by 
"paper  studies"  and  a  high  degree  of  uncertainty.  The  far- 
term  emphasis  is  on  research. 

While  this  suggested  breakout  of  the  planning  horizon 
is  rather  arbitrary,  it  is  logically  based  and  easy  to 
apply.  We  selected  5  year  periods  since  the  Services  pro¬ 
gram  in  5  year  increments  (5  Year  Defense  Planning, 
Programming,  and  Budgeting  Cycle) .  However,  there  are 
alternative  ways  to  divide  the  planning  horizon. 

The  Criteria.  With  the  planning  horizon  in  mind,  how 
do  we  evaluate  the  technology  issues  to  determine  which  are 
the  most  important  for  advocacy?  Real i sti cal 1 y,  the  cri¬ 
teria  should  relate  to  the  overall  goal  of  space  technology 
advocacy.  This  goal  is  to  provide  technology  options  to 


operators  and  systems  developers  to  meet  military  space  re¬ 
quirements.  The  R&D  process  must  not  only  be  responsive  to 
current  operational  requirements,  but  should  also  provide 
technologies  that  have  broad  application,  that  can  revolu¬ 
tionize  the  way  we  do  things  in  space,  and  that  provide  some 
hedge  against  the  uncertainty  o-f  the  -future.  Along  these 
lines  we  can  identify  three  general  reasons  for  doing  R&D. 
From  these  three  reasons  we  derive  our  criteria.  The  three 
reasons  for  doing  R2<D  are  [275:34—353: 

1.  R&D  aimed  at  improvements  (enhancements  to 
current  capabi 1 i ti es) .  For  example,  surid  vabi 1 i ty 
of  satellites  may  fall  here  where  no  performance 
improvement  is  made  but  whereby  the  satellite  can 
perform  its  mission  for  a  longer  period  of  time 
because  it  is  more  survivable. 

2.  R&D  aimed  at  new  capabilities  within  the  con¬ 
text  of  current  tasks.  This  category  provides  for 
"unique"  technological  advantages  in  doing  current 
tasks  (i.e.  do  them  better  by  doing  them  differ¬ 
ently).  For  example,  if  nuclear  intercept  of 
satellites  is  possible,  can  the  technology  be 
developed  to  provide  successful  intercept  using 
strictly  conventional  warheads/weapons? 

3.  R2<D  aimed  at  providing  new  (enabling)  capabil¬ 
ities  that  are  beyond  the  scope  of  current  tasks. 

In  other  words,  this  category  gives  the  capability 
to  do  completely  new  tasks.  An  example  of  this 
would  be  intercept  of  ICfctfi’s  in  their  boost  phase. 

This  cannot  be  done  today.  Within  this  category 
are  those  tasks  and  requirements  that  will  exist 
in  the  future  but  are  as  yet  unidentified  and 
unspecified. 

The  technology  issues  (and  the  way  we  have  defined  them) 
can  be  shown  to  apply  to  one  or  more  of  the  above  three 
reasons  for  doing  R&D.  We  now  identify  and  explain  the 
three  criteria  to  be  used  in  the  analysis  of  the  strategic 
and  technical  utility  of  various  space  technology  issues. 


Criterion  1.  Provide  performance  levels  neces¬ 
sary  to  meet  the  threat  and/or  projected  threat  within  the 
space  arena.  In  other  words,  how  -far  does  the  technology 
issue  go  in  supporting  known  mission  requirements  and  tasks? 
In  some  cases  this  can  be  quanti tati vel y  described.  The 
presence  of  a  shortfall  in  performance  level  would  indicate 
the  existence  of  one  or  more  technology  issues.  This  crite¬ 
rion  allows  the  decision  maker  to  compare  two  technology 
issues  in  the  context  of  how  important  is  one  to  the  other 
in  terms  of  the  quality  provided  by  the  technology  issues  to 
the  successful  accompl i shments  of  military  tasks.  This 
assessment  would  be  partly  based  on  the  application  of  these 
technology  issues  to  various  military  functions  and  tasks 
and  to  the  relative  importance  of  the  these  functions  and 
tasks  to  each  other.  The  relative  importance  of  functions, 
tasks,  and  missions  can  be  derived  in  several  fashions. 

First,  mission  area  analysis  from  DoD,  the  Air  Staff, 
and  MAJCOM’s  can  aid  the  decision  maker  in  making  the 
assessment.  Also,  policy  statements  from  national  leaders, 
both  civilian  and  military,  can  give  the  decision  maker  some 
insight  into  the  relative  importance  of  various  missions  and 
tasks.  Other  sources  for  this  information  are  the  planning 
documents  that  exist  within  DoD  and  the  Air  Force.  Finally, 
the  knowledge  and  experience  of  the  decision  maker  is,  in 
the  end,  the  most  important  source  of  information  and  judg¬ 
ment  for  making  the  assessment. 

It  is  important  to  note  that  technology  importance  can, 
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in  one  sense,  be  based  on  providing  a  "significant”  advan¬ 


tage  over  possible  adversaries.  The  first  criterion  encom¬ 
passes  this  assessment  of  a  technology  issue  in  terms  of 
providing  a  significant  advantage.  However,  a  significant 
advantage  may  only  be  a  marginal  advantage  in  performance 
level  in  a  given  technology  issue  vis-a-vis  the  threat.  The 
word  significant  in  no  way  necessarily  implies  a  major 
improvement  in  a  technology  area.  In  fact,  the  exploitation 
of  small  advantages  or  differences  in  technology  within 
actual  weapon  systems  can  be  decisive  1187:303.  Moreover,  a 
great  deal  of  space  R&D  will  be  pursued  to  provide  marginal 
improvements  to  existing  capabilities. 

There  is  some  danger  in  using  this  criterion  and  eval¬ 
uating  space  technology  issues  strictly  in  terms  of  the 
percent  of  "possible"  mission  area  support  that  could  be 
provided  by  the  technology  issues.  The  decision  maker  must 
be  aware  of  some  of  these  shortfalls.  Recall  that  TRUMP 
relied  upon  mission  area  analysis  and  developed  a  mission 
requirement/concept/project  ranking.  Some  widely  recognized 
problems  with  this  type  of  analysis  are  identified  by  Smith 
C226:23  and  listed  below: 

1.  Ranking  of  mission  requirements  is  arbitrary 
(everybody  has  a  different  ranking). 

2.  Fledgling  new  technologies  that  could  inspire 
radically  new  system  concepts  are  handicapped  (20 
years  ago,  would  lasers  have  been  funded  using 
mission  ranking?). 

3.  Differing  likelihoods  of  being  able  to  imple¬ 
ment  system  "concepts"  are  not  considered  (tech¬ 
nology  development  money  could  be  wasted  on  pipe 
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4.  Allocation  by  rank  is  sequential  and  piecemeal. 

We  add  a  -fifth  pitfall.  Mission  requirements  often  are 
specified  in  great  detail  before  the  military  is  given  a 
chance  to  discover  the  true  nature  of  the  operating  environ¬ 
ment.  This  may  be  particularly  true  for  the  space 
environment.  We  can  easily  link  this  back  to  the  need  to 
develop  the  environmental  doctrine  for  space  and,  from  that, 
define  space  mission  requirements  better. 

Again,  the  first  criterion  is  important  but  not  the 
only  consideration  when  developing  a  strategy  for  space 
technology  advocacy.  This  leads  directly  to  the  next 
criterion  which  addresses  some  of  the  shortfalls  described 
above. 

Criterion  2.  Provide  alternative  applications 
to  meet  many  military  tasks.  In  other  words,  what  is  the 
potential  for  exploiting  the  technology  issue.  As  pointed 
out  above,  this  is  a  good  criterion  to  weight  those  fledg¬ 
ling  technologies  that  may  have  application  to  as  yet  un¬ 
identified  tasks  and  to  allow  us  to  do  current  tasks  in  new 
and  unexpected  ways. 

Let’s  take  a  look  at  laser  technology,  for  example.  Not 
only  does  the  laser  have  application  in  the  future  as  a 
weapon  but  it  also  has  applications  in  laser-gyros,  laser 
range-f inders,  laser  target  designators,  not  to  mention  the 
hundreds  of  civilian  applications  of  the  laser.  However, 
many  of  these  applications  could  not  be  forecast  twenty 


years  ago.  But  most  researchers  knew  there  was  great  promise 
although  not  yet  identified.  In  other  words,  a  laser  tech¬ 
nology  issue  may  be  robust  in  the  number  o-f  possible  appli¬ 
cations  that  can  -flow  -from  it.  Some  o-f  these  applications 
may  not  be  recognizable  or  have  been  identified  until  well 
after  the  maturity  of  the  technology.  However,  in  many 
cases  the  applications  that  have  been  identified  are  only 
the  tip  of  the  iceberg. 

This  second  criterion  is  partially  redundant  with  the 
first  criterion.  However,  this  criterion  relates  more  to 
the  potential  application  of  the  technology  issue.  One  good 
example  of  this  is  communications  issues.  These  issues  will 
show  up  in  practically  any  system  concept.  However,  whether 
or  not  the  communication  performance  level  addressed  by  the 
technology  issue  is  truly  of  higher  quality  than  another 
technology  issue  is  addressed  using  the  first  criterion. 

Again,  criterion  1  relates  to  the  quality  of  the  tech¬ 
nology  issue  as  it  relates  to  the  importance  of  military 
functions,  tasks,  and  missions  in  the  context  of  doing  these 
missions  in  the  space  arena.  The  second  criterion  refers  to 
the  potential  breadth  of  application  of  the  technology  issue 
and  not  only  to  tasks  performed  in  space  but  also  to  other 
arenas.  For  example,  an  ion  propulsion  technology  issue 
would  represent,  if  resolved  successfully,  a  tremendous 
improvement  in  doing  certain  space  tasks.  Moreover,  it 
would  be  hard  to  imagine  an  ion  propulsion  technology  issue 
having  broad  application  outside  the  realm  of  space.  How- 


ever,  a  communication  issue  probably  would  have  broad  appli¬ 
cation  to  all  arenas.  The  “quality"  of  the  communication 
issue  and  the  ion-propulsion  issue  may  not  be  the  same  in 
the  context  o-f  overall  improvements  to  space  capabilities. 

Obviously,  in  an  advocacy  position,  being  able  to  link 
space  technology  issues  to  other  applications  besides  space 
can  be  an  aid  in  gaining  support  -from  other  non-space 
advocates  and  decision  makers.  Combined  support  and  advo¬ 
cacy  can  only  strengthen  the  decision  makers  bargaining 
power  when  it  comes  to  the  budget  process.  The  intent  in 
these  criteria  is  to  derive  the  "worth"  o-f  technology 
issues.  The  intent  of  advocacy  is  not  to  get  "control"  of 
the  programs.  Moreover,  some  decentralization  of  control  of 
the  R&D  process  leads  to  a  more  robust  technology  base 
C118:243].  However,  a  final  criterion  is  needed  to  address 
the  uncertainty  inherent  in  mission  requirement  identifica¬ 
tion  and  performance  specifications,  threat  projections  and 
R&D  processes. 

Criterion  3,  Provide  a  "hedge”  against  techno¬ 
logical  surprise  and  uncertainty.  A  good  example  for  this 
is  again  the  SDI  initiative.  One  reason  for  pursuing  R&D 
programs  in  this  area  is  to  be  capable  of  responding  to  a 
Soviet  breakout  from  the  ABM  treaty.  An  unanswered  tech¬ 
nology  breakthrough  in  this  area  could  be  "catastrophic"  for 
the  defense  and  security  of  the  United  States  (see  C473  for 


further  discussion  on  the  SDI  initiative).  Also,  some  pro¬ 


posed  technology  issues  within  SDI  are  highly  uncertain  as 
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to  their  eventual  resolution.  Hence,  these  types  o-f  tech¬ 
nology  issues  will  undoubtedly  be  rated  fairly  high  under 
this  criterion. 

Within  this  criterion,  technology  issues  can  be  ad¬ 
dressed  because  of  the  "lack  of  research"  and  as  a  means  of 
reducing  uncertainty.  The  literature  (see  chapter  two) 
spends  a  great  deal  of  time  on  treating  risk  and  uncertainty 
in  their  portfolio  selection  models.  However,  one  of  our 
hypotheses  is  that  in  the  space  technology  advocacy  problem 
the  fact  that  a  program  or  technology  issue  is  high  risk 
and/or  uncertain  may  be  a  good  reason  for  advocacy.  Some¬ 
times  the  high  risk/high  payoff  technology  is  the  one  to 
pursue  in  terms  of  satisfying  future,  and  possibly  unidenti¬ 
fied,  mission  requirements.  If  the  goal  is  to  develop  those 
technologies  necessary  to  provide  options  to  meet  future 
mission  requirements  then  it  may  well  be  that  the  high  risk- 
project  is  the  only  way  to  get  there  and,  hence,  needs  to  be 
advocated  for  that  reason.  For  example,  some  of  the  SDI 
technology  issues  are  important  to  investigate  because  their 
resolution  will  determine  the  very  feasibility  of  the  con¬ 
cept  of  BMD.  Determining  this  feasibility  will  have  a  major 
impact  on  future  defense  options  and  will  definitely  have  a 
tremendous  impact  on  the  national  budget. 

From  this  description  it  becomes  readily  apparent  that 
these  three  criteria  are  extremely  difficult  if  not  impossi¬ 
ble  to  measure  quantitatively.  However,  the  space  technol¬ 
ogy  advocate  can  apply  these  three  criteria  subjectively 
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when  evaluating  the  relative  strategic  and  technical  utility 
o-f  a  set  of  space  technology  issues.  These  three  criteria 
are  linked  directly  to  the  proposed  space  R&D  advocacy 
hierarchy  (Figure  5-2). 

The  first  criterion  relates  to  the  "mission  needs" 
hierarchy,  linking  technology  issues  through  the  military 
instrument  of  national  power  to  national  interests.  This 
criterion  deals  mainly  with  the  deterministi c  side  of  the 
military  technology  problem.  This  side  has  well  defined 
tasks  and  possibly  well-defined  performance  characteri sties. 
In  other  words,  the  military  operators  and  researchers  basi¬ 
cally  know  what  they  need  and  have  some  idea  of  how  to  get 
there. 

The  last  two  criteria  deal  with  the  uncertainty  side  of 
the  technology  problem.  The  implications  of  successful 
resolution  of  the  technology  issue  cannot  be  fully  deter¬ 
mined  given  present  information.  Also,  these  two  criteria 
cover  technology  issues  that  may  lead  to  as  yet  unidentified 
military  tasks  and  applications.  The  space  technology  pro¬ 
gram  that  is  advocated  must  not  only  address  that  which  we 
can  identify  but  must  also  pursue  unknown  future  capabili¬ 
ties  and  applications.  While  the  "mission  needs"  hierarchy 
attempts  to  consider  future  needs  by  taking  an  environmental 
doctrine  perspective,  it  may  not  be  completely  adequate  for 
covering  all  possible  uncertainties.  For  this  reason,  we 
have  expanded  the  hierarchy  to  show  linkage  through  the 
scientific-technological  instrument  of  national  power  to 
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national  interests.  This  linkage  provides  a  rational  and 
realistic  means  to  consider  the  worth  of  pursuing  "research 


•for  research's  sake"  as  a  hedge  against  many  o-f  the  uncer¬ 
tainties  o-f  the  R&D  process. 

The  purpose  o-f  this  discussion  was  to  identi-fy  and 
describe  a  robust  set  of  criteria  that  can  be  applied  in  a 
worth  assessment  of  a  set  of  space  technology  issues.  The 
three  criteria  are  robust  in  that  they  include  not  only  the 
well-defined  aspects  of  the  mission  needs  hierarchy  but  also 
"hedge"  against  the  uncertainty  that  is  an  inherent  part  of 
R&D  planning.  Moreover  these  three  criteria  are  linked  to 
policy  statements,  planning  documents,  Air  Force  regula¬ 
tions,  and  Air  Force  doctrine.  The  criteria  relate  directly 
to  the  objectives  and  goals  of  space  technology  advocacy  and 
they  appear  to  be  those  criteria  most  important  to  the 
advocacy  process,  as  they  comprehensively  address  the 
reasons  for  doing  space  R&D. 


Concl usi on 

In  this  chapter  we  described  a  hierarchical  model  for 
relating  space  technology  issues  to  national  interests.  We 
showed  that  the  linkages  can  work  up  or  down  the  hierarchy. 
For  example,  technology  issues  can  be  derived  from  evalu¬ 
ating  performance  requirements  in  the  mission  needs  hierar¬ 
chy.  Also,  the  relationship  of  technology  issues  derived 
externally  from  the  hierarchy  can  be  linked  to  other  ele¬ 
ments  in  the  hierarchy.  We  pointed  out  that  this  hierarchy 
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is  a  conceptual  model  that  can  represent  the  decision 
situation  of  the  space  technology  advocate. 

We  also  described  three  criteria  which  can  be  used  to 
prioritize  technology  issues  based  on  their  relative  impor¬ 
tance  to  the  three  criteria.  We  indicated  that  the  space 
technology  advocate  should  evaluate  technology  issues 
against  these  criteria  under  different  planning  horizons. 
This  allows  -flexibility  in  that  technology  issues  may  vary 
in  importance  depending  on  the  planning  horizon  in  which 
they  are  being  considered.  We  believe  these  criteria, 
although  broadly  de-fined,  will  prove  useful  in  prioritizing 
critical  technology  issues  necessary  to  support  the  military 
space  systems  of  the  future.  However,  a  significant  draw¬ 
back  is  that  the  criteria  are  subjective  and  not  necessarily 
independent.  With  the  possible  exception  of  the  first  and 
second  criteria,  it  would  be  impossible  to  quantitatively 
apply  them  in  a  worth  assessment  of  space  technology  issues. 

On  the  surface,  it  may  appear  we  need  go  no  further  in 
describing  a  decision  support  system  for  prioritizing  tech¬ 
nology  issues.  We  have  described  a  hierarchical  framework 
which  represents  a  model  of  reality.  We  have  identified 
criteria  against  which  candidate  technology  issues  can  be 
weighed.  However,  we  have  not  defined  a  methodology  for 
applying  these  criteria  to  prioritize  technology  issues. 
Additionally,  we  have  not  yet  described  the  decision  support 
elements  that  guide  the  decision  maker  in  his  advocacy  role. 

In  the  next  chapter  we  discuss  a  decision  support 
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implementation  plan.  It  incorporates  the  criteria  we  have 
identified  in  this  chapter  with  a  methodology  for  eliciting 
subjective  judgments  from  the  decision  maker,  in  conjunction 
with  other  information,  to  formulate  a  technology  worth 
assessment.  The  decision  maker  can  consider  this  assess¬ 
ment,  match  it  against  his  perception  of  external  factors, 
and  revise  his  assessment  accordingly.  The  final  product, 
after  perhaps  several  iterations,  is  the  space  technology 
advocacy  position.  A  model  of  this  process  is  shown  in 
Figure  5-4. 
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VI .  Implementation  of  the  Decision  Support  Methodoloav 

•for  Space  Technology  Advocacy 


Introduction 

The  previous  chapter  described  a  hierarchical  model 
that  linked  technology  issues  to  national  interests.  We 
also  developed  three  criteria  to  evaluate  technology  issues. 
In  this  chapter  we  conclude  our  description  o-f  a  decision 
support  model  for  space  technology  advocacy.  The  model 
considers  the  criteria  and  information  requirements.  These 
are  tied  together  with  an  analytical  tool  through  a  user 
interface.  Using  this  model  the  decision  maker  can  effec¬ 
tively  assess  the  worth  of  space  technology  issues.  The 
decision  maker  then  considers  this  worth  assessment  in  con¬ 
junction  with  external  factors  (many  of  which  were  described 
in  Chapter  Four)  in  developing  a  space  technology  plan. 
This  decision  support  model  is  shown  in  Figure  6—1. 

We  refer  to  the  elements  used  to  derive  a  technology 
issue  worth  assessment  as  the  decision  support  methodology. 
We  have  already  discussed  the  criteria  and  focus  on  de¬ 
scribing  three  of  the  other  elements:  information  require¬ 
ments,  analytical  tools,  and  the  user  interface. 

The  first  section  discusses  the  information  require¬ 
ments  needed  to  use  our  proposed  methodology.  Here  we 
describe  the  database,  database  management  system,  and 
information  required  to  make  technology  issue  assessments. 
Our  database  is  a  natural  extension  of  the  MSSTP  database, 


which  already  exists.  Our  proposed  methodology  recommends  a 
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Figure  6-1.  Space  Technology  Advocacy  Model 


database  management  system  that  allows  the  decision  maker  to 
interactively  process  in-formation  -from  this  space  technology 
database.  The  database  and  the  in-formation  in  it  help  -focus 
the  decision  makers’  judgments  when  evaluating  space  tech¬ 
nology  issues. 

The  second  section  is  a  discussion  of  the  analytical 
element  of  the  decision  support  model  —  the  analytic  hier¬ 
archy  process  (AHP)  .  The  AHF'  is  a  multiple  criteria 
decision  making  (MCDM)  technique.  As  pointed  out  in  Chapter 
Two,  the  AHP  has  many  advantages  over  other  MCDM  techniques. 
We  use  the  AHP  to  elicit  subjective  assessments  of  the 


various  technology  issues  from  the  decision  maker.  A 
rank/weighted  ordering  o-f  the  technology  issues  can  then  be 


derived  based  upon  each  technology  issues  contribution  to 
the  satisfaction  of  appropriate  criteria.  We  discuss 
various  ways  that  the  results  of  the  technology  issue 
analysis  can  be  interpreted  and  used  to  develop  a  space 
technology  advocacy  plan. 

The  last  section  in  this  chapter  discusses  the  user 
interface.  The  user  interface  is  addressed  in  the  context 
of  general  guidelines  for  transforming  the  methodology  into 
a  computer-based  decision  support  system  for  space  technol¬ 
ogy  advocacy.  The  decision  support  system  would  then 
provide  the  decision  maker  with  a  tool  for  making  better 
decisions. 

Information  Requirements 

In  order  for  an  analysis  to  provide  sound 
advice  it  is  essential,  of  course,  that  the  infor¬ 
mation  and  data  on  which  it  is  based  be  sound.  To 
some  extent  these  can  be  found  in  published  re¬ 
ports  and  books  or  can  be  gathered  by  the  analyst, 
but  to  a  large  extent  it  must  be  found  in  the 
minds  of  experts.  Moreover,  expert  judgment  and 
intuition  must  be  used  to  interpret  it  1189:1871. 

In  this  section  we  present  the  information  requirements 
for  this  methodology  including  a  preferred  database  struc¬ 
turing.  We  describe  this  database  structure  within  the 
context  of  a  relational  database,  which  is  an  improvement 
over  the  MSSTP  hierarchical  database  structure  used  in  the 
MSSTP  database.  This  relational  database  can  be  easily 
manipulated  to  filter  out  subsets  of  technology  issues.  We 
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Figure  6—2.  Space  Technology  Advocacy  Model 
Information  Requirements 


note  here  that  we  are  describing  an  ideal  lection  of 
information.  In  actual  practice  much  needed  information 
will  not  be  available  and  may  not  even  exist. 

One  of  the  most  difficult  steps  in  gathering  informa¬ 
tion  is  determining  the  actual  information  requirements. 
Sage  1207:1521  identifies  several  methods  of  determining 
information  requirements  £207:1521: 


1.  Simply  ask  people  for  their  requirements. 


2.  Elicit  in-formation  requirements  -from  existing 
systems  that  are  similar  in  nature  and  purpose  to 
the  one  in  question. 

3.  Synthesize  information  requirements  from 
characteri sties  of  the  utilizing  system.  Basical¬ 
ly,  by  determining  the  types  of  questions  that  a 
decision  maker  wants  to  answer  you  can  determine 
the  type  of  information  needed  in  order  to  provide 
the  answer  to  the  question. 

4.  Discover  needed  items  of  information  by  exper¬ 
imentation. 

Sage  1207:1423  goes  on  to  cite  several  assumptions  that 
can  be  made  about  information. 

1.  The  amount  of  initially  available  information 
is  usually  only  a  small  fraction  of  what  could  be 
avai 1 abl e. 

2.  The  economic  and  other  costs  of  obtaining 
additional  information  is  often  large. 

3.  Important  information,  especially  that  infor¬ 
mation  that  pertains  to  future  events,  is  often 
incomplete,  imprecise,  and  uncertain. 

4.  It  is  important  that  the  information  in  the 
database,  or  otherwise  available  to  the  decision 
maker,  not  bias  the  decision  maker  and  that  as 
complete  a  picture  as  possible  be  provided  to  him. 

Data  Requirements.  In  this  section  we  briefly  describe 
the  information  that  should  be  available  to  the  decision 
maker.  First,  we  assume  that  a  "list"  of  technology  issues 
is  already  available.  As  pointed  out  in  Chapter  5  these 
technology  issues  can  be  identified  in  a  variety  of  ways. 
We  also  assume  that  other  data  is  available  such  as  approxi¬ 
mate  technology  requirements  and  technology  availability 
dates. 

The  database  should  also  contain  information  regarding 


the  number  and  type  of  projects  currently  being  budgeted 
against  a  particular  technology  issue  (if  any  exist).  Also, 
technology  issue  dependencies  as  well  as  possibly  mutually 
inclusive  and  exclusive  technology  issues  should  be  identi¬ 
fied.  The  original  MSSTP  database  contained  information  of 
this  type. 

The  elements  of  information  that  should  be  available  to 
the  Space  Technology  Advocate  when  assessing/pairwise— 
comparing  technology  issues  with  respect  to  the  criteria  are 
listed  below: 

—  technology  due  date 

—  technology  start  date 

—  current  "funded"  programs 

—  other  advocates 

—  concepts  that  the  technology  issue  could  be  applied  to 

—  technology  discipline  within  which  the  technology 
i ssue  1 i es 

—  performance  figures  of  merit  in  terms  of  current 
state-of-the-art,  projected  state-of-the-art 

—  DOD  executive  agent 

—  primary  laboratory  or  "actor"  that  would  actually 
attempt  to  resolve  the  technology  issue 

—  nominal  projections  of  R&D  life  cycle  cost  of  addres¬ 
sing  the  technology  issue 

—  summarized  description  of  the  technology  issue 

—  linkage  to  the  mission  needs  hierarchy  if  known 

—  intelligence  estimates  of  current  and  projected  threat 

—  points  of  contact 

—  sources  of  additional  written  information.  This  could 


include  DTIC  reports,  AIAA  panel  reports,  etc. 

This  type  of  information  should  be  readily  accessible 
to  the  Space  Technology  Advocate  when  assessing  technology 
issues.  For  efficient  access  the  information  should  be 
available  in  an  organized  format.  This  is  easily  accom¬ 
plished  using  a  computer  database  and  database  management 
system. 

Database  Management.  The  principal  virtue  of  a  data¬ 
base  management  system  is  that  it  frees  both  the  information 
seeker  and  the  information  supplier  from  any  need  to  under¬ 
stand  the  complexities  of  the  computer,  which  allows  them  to 
concentrate  on  the  data.  In  the  case  of  a  relational  data¬ 
base  management  system,  the  structure  of  the  data  is  compact 
and  hence  "large"  databases  can  be  integrated  into  microcom¬ 
puter  applications.  For  example,  assuming  200  technology 
issues,  with  10,000  bytes  of  information  per  technology 
issue  (approximately  8  pages  of  text),  the  storage  require¬ 
ments  would  be  approx i matel y  2  MegaBytes  of  memory.  This  is 
well  below  the  limit  of  10  MegaByte  Hard  Disk  storage  media 
that  are  currently  available  for  most  microcomputers. 

There  are  several  ways  to  organize  a  database  C1973. 
The  MSSTP  is  organized  hi erarchi cal  1 y .  We  recommend  a  rela¬ 
tional  database.  We  now  compare  these  two  database  struc¬ 
tures  and  highlight  the  advantage  of  the  relational  type. 

The  hierarchical  model  C197:53D  can  be  defined  as  a  set 
of  record  types  with  a  set  of  links  between  record  types. 
All  record  types  have  links  and  to  each  record  there  corre— 


sponds  exactly  one  other  record  called  the  parent.  The 
number  o-f  links  is  restricted  to  at  most  one  between  two 
record  types.  Finally,  there  is  a  unique  record  type  with 
no  parent  record  type  called  the  root  record  type.  In  other 
words,  the  hierarchical  model  can  be  represented  by  a  tree 
structure  as  illustrated  in  Figure  6-3.  The  hierarchical 
model  involves  a  complicated  physical  structure  with  data 
dependent  upon  the  links  that  are  established  within  the 


database.  These  links  take  up  available  memory. 


peating  groups).  Second,  in  any  column  all  data  items  are 
of  the  same  kind.  Third,  each  column  is  given  a  distinct 
name.  Further,  all  rows  are  distinct  (no  duplicate  rows  are 
allowed).  Finally,  both  the  rows  and  columns  can  be  viewed 
in  any  order  at  any  time  without  affecting  the  information 
content  of  any  function  using  the  table. 

A  flat  file  observing  these  rules  is  a  relation.  A 
column  is  called  an  attribute.  The  flat  file  representing  a 
record  type  having  columns  containing  data  item  values  and 
rows  called  records  becomes  a  relation.  The  database  can  be 
manipulated  by  referencing  the  appropriate  attributes.  A 
good  example  of  a  relational  database  is  the  telephone  book. 


Figure  6-4  shows  a  sample  relational  database.  The 
attributes  are  technology  issue  name,  the  executive  agent, 
the  technology  start  date,  and  the  technology  due  date. 
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Figure  6—4.  Relational  Database 


In  effect,  if  a  relational  database  is  built  around 
suitable  attributes,  sort/search  techniques  can  be  applied 


in  order  to  scope  the  problem  for  the  decision  maker.  The 
■following  attributes  could  be  valuable  in  reducing  the  scope 
of  the  decision  situation  for  the  decision  maker  when  he 
evaluates  the  various  space  technology  issues:  time  period, 
type  of  research  (61xx,  etc.),  technology  discipline,  major 
actors  (i.e.  labs),  technology  due  date,  technology  start 
date,  and  major  mission  area. 

Besides  having  sort /search  techniques  available,  the 
database  management  system  should  include  algorithms  that 
allow  the  user  to  manipulate  and  analyze  the  data.  One 
obvious  area  for  this  type  of  application  are  decisions 
involving  budgetary  impacts.  Obviously,  this  requires 
funding  data  be  made  available.  However,  it  is  unlikely 
that  all  such  data  will  exist  and  will  probably  have  to  be 
approximated  by  the  experts.  An  algorithm  to  do  this  could 
include  the  presentation  of  simple  funding  curves  to  the 
decision  maker  or  expert.  An  interactive  algorithm  then 
prompts  the  decision  maker  to  choose  the  most  likely  shape 
of  the  funding  curve  as  well  as  to  specify  nominal  time  and 
budget  figures.  The  algorithm  can  then  calculate  a  yearly 
budget  requirement  and  this  then  can  be  used  to  assess 
decisions  in  terms  of  budgetary  impact.  However,  the  deci¬ 
sion  maker  should  be  cautioned  that  this  type  of  analysis 
tends  to  be  inaccurate  due  to  the  highly  uncertain  nature  of 
the  problem.  Hence,  wrong  conclusions  can  easily  be  made. 
Appendix  H  shows  a  simple  example  of  this  algorithm. 

The  key  paints  here  are  that  the  database  management 


algorithms  should  be  flexible  enough  to  address  many  differ¬ 


ent  subsets  of  technology  issues,  and  should  allow  the  user 
to  manipulate  the  data  so  he  can  address  his  decision  situa¬ 
tion  with  the  best  available  information. 

The  next  section  presents  the  analytic  hierarchy  pro¬ 
cess  and  how  it  is  used  to  apply  the  planning  horizons  and 
the  criteria  in  order  to  prioritize  technology  issues  as 
part  of  the  space  technology  advocacy  strategy. 

The  Analytic  Hierarchy  Process 

Expert  opinion  must  be  called  on  whenever  it 
becomes  necessary  to  choose  among  several  alterna¬ 
tive  courses  of  action  in  the  absence  of  an  ac¬ 
cepted  body  of  theoretical  knowledge  that  would 
clearly  single  out  one  course  as  the  preferred 
alternative  [189:1971. 

The  analytic  hierarchy  process  ( AHP)  is  the  multiple 
criteria  decision  making  technique  (the  analytic  tool  in 
Figure  6—5)  we  have  chosen  to  elicit  the  subjective  prefer¬ 
ences  of  the  space  technology  experts  and  as  the  way  in 
which  to  prioritize  technology  issues.  The  technology 
issues  are  prioritized  by  the  technology  advocate  and/or  his 
staff  according  to  the  three  criteria  discussed  in  the 
previous  chapter.  This  section  discusses  the  AHP  technique 
in  general  and  shows  how  it  can  be  used  in  the  overall  space 
technology  advocacy  methodology. 

The  analytic  hierarchy  modeling  and  measurement  process 
developed  by  Saaty  C198;  200;  202;  2033  is  a  recent  addition 
to  the  many  approaches  used  to  determine  the  relative 
importance  of  a  set  of  activities  or  criteria  C280:6413. 


mechanism  to  elicit  the  subjective  judgments  of  experts  as 
these  judgments  pertain  to  the  pri ori ti zati on  of  space  tech¬ 
nology  issues. 

Since  we  are  concerned  with  a  decision  maker’s  prefer¬ 
ence  for  technology  issues,  we  must  have  a  model  which 
provides  for  and  can  deal  with  subjective  inputs.  The  AHP 
provides  a  nice  tool  for  this  and  is  relatively  easy  to 
learn  and  to  use. 

In  the  space  technology  advocacy  problem,  the  process 
of  judgment  involves  making  pairwise  comparisons  between 
technology  issues  according  to  a  given  criterion  12:943. 
The  AHP  allows  the  decision  maker  to  do  this  by  breaking  the 
problem  into  three  stages.  First,  the  problem  is  decomposed 
into  a  hierarchy  (see  Figure  6-6)  with  each  level  consisting 
of  a  few  manageable  elements.  Second,  the  elements  of  the 
hierarchy  are  assessed  or  prioritized  by  using  the  nine 
point  scale  shown  in  Figure  6-7.  Third,  all  the  priorities 
are  pulled  together  through  the  "principle  of  hierarchical 
composition"  to  provide  the  overall  assessment  of  the  tech¬ 
nology  issues  C198:5j  203:1;  266:613.  It  is  important  to 
note  that  structuring  a  problem  hi erarchi cal  1 y  can  be  con¬ 
sidered  an  art  since  there  is  no  "one  best  way"  of  hierar¬ 
chical  structuring  1266:613.  In  our  case,  we  have  con¬ 
structed  a  relatively  simple  hierarchy  without  the  partici¬ 
pation  of  the  decision  maker.  We  feel  this  is  a  weakness  in 
the  approach  (the  decision  maker  should  be  involved  in 
developing  the  hierarchy)  and  not  necessarily  in  the  valid- 


in 


ity  of  the  hierarchy.  The  hierarchy  that  we  actually  used 
in  testing  the  methodology  (Chapter  7)  is  presented  in 


Figure  6—6. 
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Figure  6-6.  AHP  Hierarchy  for  Technology  Assessment 


We  now  summarize  the  steps  of  the  Analytic  Hierarchy 

Frocess.  These  steps  are  taken  from  the  fallowing  sources: 

C202:142;  266:68;  280:6461. 

Step  1:  Define  the  problem  and  determine  what  you 
want  to  know. 

Step  2:  Structure  the  hierarchy  from  the  top  (the 
objectives  from  a  general  viewpoint)  through  the 
intermediate  levels  (criteria  on  which  subsequent 
levels  depend)  to  the  lowest  level  (which  in  our 
case  is  the  list  of  the  technology  issues  l'1 
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quest icn) . 


Step  3:  Construct  a  set  of  pairw!-e  comparison 
matrices  for  each  of  the  *_-,“r  levels  —  one 
matrix  for  each  elemt..1-  in  the  level  immediately 
above.  An  e.1  -"ent  in  the  higher  level  is  said  to 
be  a  go.r-ning  element  for  those  in  the  lower 
level  since  it  contributes  to  it  or  affects  it. 
In  a  complete  simple  hierarchy,  every  element  in 
the  lower  level  affects  every  element  in  the  upper 
level.  The  elements  in  the  lower  level  are  then 
compared  to  each  other  based  on  their  effect  on 
the  governing  element  above.  This  yields  a  square 
matrix  of  judgments.  The  pairwise  comparisons  are 
done  in  terms  of  which  element  dominates  another. 
These  judgments  are  then  expressed  as  integers 
(see  table  below).  If  element  A  dominates  over 
element  B,  then  the  whole  number  integer  is  en¬ 
tered  in  row  A,  column  B  and  the  reciprocal 
(fraction)  is  entered  in  row  B,  column  A.  Of 
course,  if  element  B  dominates  element  A  then  the 
reverse  occurs.  The  whole  number  is  then  placed 
in  the  B,A  position  with  the  reciprocal  automat¬ 
ically  being  assigned  to  the  A,B  position.  If  the 
elements  being  compared  are  equal,  a  one  is 
assigned  to  both  positions. 

Step  4:  There  are  n(n-l>/2  judgments  required  to 
develop  the  set  of  matrices  in  step  3  (remember, 
reciprocals  are  automatically  assigned  in  each 
pairwise  comparison). 

Step  5:  Having  made  all  the  pairwise  comparisons 
and  entered  the  data,  the  consistency  index  is 
computed  using  the  eigenvalue.  This  index  gives  a 
measure  of  the  decision  maker's  consistency  in  his 
pairwise  comparisons. 

Step  6:  Steps  3,  4,  and  5  are  performed  for  all 
levels  and  clusters  in  the  hierarchy. 

Step  7:  Hierarchical  composition  is  now  used  to 
weight  the  eigenvectors  by  the  weights  of  the 
criteria  and  the  sum  is  taken  over  all  weighted 
eigenvector  entries  corresponding  to  those  in  the 
next  lower  level  of  the  hierarchy. 

Step  8:  The  consistency  of  the  entire  hierarchy 
is  found  by  multiplying  each  consistency  index  by 
the  priority  of  the  corresponding  criterion  and 
adding  them  together.  The  result  is  then  divided 
by  the  same  type  of  expression  using  the  random 
consistency  index  correspond! ng  to  the  dimensions 


of  each  matrix  weighted  by  the  priorities  as 
before.  Note  first  that  the  consistency  ratio 
should  be  about  10  percent  or  less  to  be  accepta¬ 
ble.  If  not,  the  quality  of  the  judgments  should 
be  improved,  perhaps  by  revising  the  manner  in 
which  questions  are  asked  in  making  the  pairwise 
comparisons.  If  this  should  fail  to  improve 
consistency,  then  it  is  likely  that  the  problem 
should  be  more  accurately  structured;  that  is, 
grouping  similar  elements  under  more  meaningful 
criteria.  A  return  to  Step  2  would  be  required, 
although  only  the  problematic  parts  of  the  hierar¬ 
chy  may  need  revision. 

Appendix  I  describes  the  actual  mathematical  calcula¬ 
tions  required  in  the  AHP. 

The  process  of  eigenvector  extraction  and  hierar¬ 
chical  weighting  and  composition  leads  to  a  unidimensional 
scale  for  the  properties  of  the  elements  in  any  level  of  the 
hierarchy.  The  resulting  technology  issue  priorities  repre¬ 
sent  the  intensity  of  the  respondents’  judgments  as  to  the 
relative  importance  of  the  technology  issues  represented  in 
the  hierarchy'  considering  the  importance  of  and  tradeoff 
among  the  criteria.  In  any  case,  these  priorities  depend  on 
subjective  preference  and  judgment  Cl  19: 1561.  The  AHP 
produces  a  single  quantitative  measure  for  each  criterion 
for  the  purpose  of  prioritizing  the  technology  issues.  The 
relative  weights  obtained  through  the  AHP  can  then  be  used 
to  develop  a  rational  space  technology  advocacy  plan. 

We  assume  that  the  appropriate  forum  for  space  tech¬ 
nology  assessment  is  expert  groups.  The  AHP  is  also  an 
effective  tool  in  a  group  setting.  The  next  section  dis¬ 
cusses  the  use  cf  the  analytic  hierachy  process  in  the 


context  of  group  problem  solving. 
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cal  e  o-f  Relative  Imoortance  used  in  the  AHP 


Definition 
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is  demonstrated  in 
practi ce 

The  evidence  favoring  one 
activity  over  another  is 
of  the  highest  possible 
order  of  affirmation 


,4,6,S 


Intermediate  values 
between  the  two 
adjacent  judgments 


When  compromi se 
needed 


Reciprocal  s 
of  above 
non— z  ero 
numbers 


If  an  activity  has  one  of  the  above  numbers 
assigned  to  it  when  compared  with  a  second 
activity,  then  the  second  activity  has  the 
reciprocal  value  when  compared  to  the  first. 


Figure  6-7.  AHF'  Scale  of  Relative  Importanc 
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When  dealing  with  a  multi-faceted  problem  with 
the  aid  of  a  variety  of  experts  of  different 
backgrounds,  perhaps  the  most  important  require¬ 
ment  in  the  interest  of  an  efficient  use  of  these 


experts  is  to  provide  an  effective  means  of 
communication  among  them.  Since  each  of  the 
participating  experts  is  likely  to  have  his  own 
specialised  terminology,  a  conceptual  alignment 
and  a  real  agreement  as  to  the  identity  of  the 
problem  may  not  be  easy  to  achieve,  and  it  becomes 
almost  imperative  to  construct  a  common  frame  of 
reference  in  order  to  promote  a  unified  collabo¬ 
rative  effort  (Olaf  Helmer  in  "The  Systematic  Use 
of  Expert  Judgment  in  Operations  Research"  as 
quoted  in  £139:1903). 

We  do  not  assume  that  a  single  decision  maker  will  be 
able  to  real i stical ly  assess  hundreds  of  technology  issues. 
In  fact,  this  methodology  is  well-suited  for,  and  should  be 
used  by,  expert  groups  in  assessing  the  strategic  and  tech¬ 
nical  utility  of  selected  subsets  of  space  technology 
issues.  This  section  describes  some  aspects  of  group  prob¬ 
lem  solving  in  the  context  of  using  the  AHP  as  an  analytical 
tool  to  assess  space  technology  issues. 

First,  a  short  discussion  of  the  composition  of  the 
expert  groups  is  necessary.  An  example  is  probably  the  best 
way  to  show  the  expertise  required  to  use  this  methodology 
effectively  to  assess  technology  issues. 

Assume  that  comrauni cati on  issues  are  to  be  prioritized. 
The  group  should  consist  of  communication  experts  that  have 
a  broad  background  in  the  communication  field,  i.e.  communi¬ 
cation  technologists.  Also,  included  in  this  group  should 
be  military  officers  well-versed  in  the  military  aspects  of 
communication.  Hence,  the  group  is  composed  of  technical 
experts  and  military  experts.  In  a  sense,  this  group  is 
composed  of  specialists  and  generalists.  As  Quade  £189:1873 
states  "the  specialists  provide  substantive  information  and 


prediction,  whereas  the  generalists  of ter  problem  formula¬ 
tion,  model  structuring,  or  preference  evaluation  among  the 
predicted  alternatives." 

The  exact  size  of  the  group  is  not  so  important  as  long 
as  the  participants  have  shared  goals,  intimate  long  term 
contact  and  work  in  a  climate  of  social  acceptance  with  each 
member  having  equal  status  when  participating  C203:313. 
However,  the  number  probably  should  not  be  less  than  five 
nor  more  than  twelve  members.  This  is  the  "ideal"  group 
composition  C1083.  If  the  ideal  group  cannot  be  assembled 
then  it  is  paramount  that  the  group  leader  ensure  that  the 
group  remains  focused  on  the  issues  at  hand  and  that  all 
questions  are  specific  and  interpreted  the  same  way  by  all 
group  members. 

The  use  of  the  AHP  in  this  group  setting  is  an  adapta¬ 
tion  of  Saaty  C198;  202;  2033  and  Lockett,  et.  al .  C1553  and 
Gear,  et.  al  C96D.  Basically,  the  technique  is  the  Delphi 
method  or  nominal  group  technique  coupled  with  the  AHP.  The 
Delphi  method  would  be  used  when  the  group  cannot  get 
together.  The  nominal  group  technique  is  appropriate  when 
the  group  members  can  physically  get  together.  This  tech¬ 
nique  allows  the  individuals  in  the  group  to  have  the 
benefit  of  the  AHP  methodology  including  the  measure  of 
inconsistency.  By  each  individual  providing  separate  infor¬ 
mation  it  is  possible  to  better  utilize  the  experience  of 
the  group  and  provide  a  mechanism  for  articulation  of  sub¬ 
jective  estimates  of  the  relative  worth  of  the  technology 
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A  word  picture  of  the  group  process  is  presented  below. 
Appendix  J  presents  additional  mathematical  and  statistical 
elements  that  can  used  with  the  AHP  in  a  group  setting. 

The  group  o-f  experts  would  first  be  educated  in  the  AHP 
technique  by  presenting  them  with  an  outline  of  the  method, 
including  those  parts  applicable  to  the  group  situation. 
They  would  then  be  presented  with  an  example  problem  to  show 
the  flow  of  the  process.  Finally,  the  specific  problem  at 
hand  is  presented  along  with  the  proposed  AHP  hierarchy.  A 
discussion  then  takes  place  in  order  to  clarify  the  hierar¬ 
chy  and  the  technology  issues  and  criteria.  It  is  at  this 
stage  that  the  activities  of  separate  divisions  within  the 
Air  Force  F:S<D  community  can  be  structured  separately,  with 
the  aid  of  the  database  and  the  database  management  system 
al  gori  thins. 

Once  agreement  has  been  reached  on  the  form  of  the 
problem  and  the  method  to  be  used  in  the  assessment,  each 
individual  in  the  group  then  goes  through  the  hierarchy  and 
gets  a  weighted  preference  for  technology  issues.  Obvious¬ 
ly,  each  member  should  have  access  to  the  information  in  the 
database  as  well  as  any  other  technical  documents  or  mission 
area  analyses  that  might  help  him  make  a  better  informed 
choice.  After  this,  the  group  is  brought  back  together  and 
each  would  receive  an  "average"  group  result  presented  for 
comparison  with  their  own  results.  A  discussion  then  takes 
place  about  the  results,  their  perceptions,  and  their 


dif  f  erences. 


Some  simple  visual  aids  would  aid  the  group  discussion. 
For  example,  a  simple  histogram  and  some  descriptive  statis¬ 
tics  can  be  applied  to  the  members’  results.  In  this  way,  a 
visual  group  assessment  is  available.  Obviously  a  "tight" 
histogram  with  a  small  variance  indicates  some  degree  of 
consensus.  A  histogram  with  a  wide  variance  and  an  almost 
uniform  distribution  of  points  indicates  that  more  discus¬ 
sion  and/or  information  is  needed.  For  example  Figure  6—8 
shows  a  bimodal  distribution  of  pairwise  comparisons.  In 
this  case  there  is  significant  disagreement  among  group 
members.  Further  discussion  and  additional  information  may 
be  necessary  to  ultimately  achieve  consensus. 
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Figure  6—8.  Histogram  of  Pairwise  Comparisons 

When  all  members  have  finished  going  through  all  levels 
of  the  hierarchy,  they  are  brought  back  together  and  given 
the  comparative  data.  Another  group  discussion  takes  place. 
Fallowing  this,  either  a  re-run  of  the  model  is  in  order  or 
possibly  a  close-down.  Hopefully,  consensus  is  reached  on 
the  ranking  of  the  technology  issues. 

During  this  process  each  individual’s  input  is  monitored 
so  that  a  complete  record  is  available  of  their  actions. 


This  is  important  for  later  interpretation  of  results  and 


sensitivity  analysis.  Also,  each  individual’s  analysis  is 
kept  from  the  group  during  this  process  so  as  to  reduce 
group  pressure.' 

Obviously,  this  process  is  greatly  facilitated  by  an 
interactive  personal -computer  program  (We  used  Expert 
Choi ce  mentioned  previously).  The  interactive  program 
presents  the  choices  in  a  pairwise  fashion  to  the  expert. 
The  expert  then  enters  his  pairwise  subjective  estimates  of 
the  relative  worth  of  each  of  the  technology  issues,  one  to 
the  other.  If  the  problem  has  been  scoped  down  in  size 
sufficiently,  we  would  recommend  that  the  experts  also  enter 
short,  free-text  explanations  justifying  their  choices. 
Listings  of  various  experts’  documented  pairwise  comparisons 
and  their  explanations  provide  a  very  handy  method  to  pin¬ 
point  differences  among  the  experts  £226:101  and  as 
additional  summarized  information  available  for  addition  to 
the  database. 

The  next  section  describes  the  sensitivity  analysis 
that  can  be  applied  to  the  group  results. 

Sensitivity  Analysis. 

The  uncertainties  of  most  planning  problems 
can  never  be  completely  eliminated  1146:571. 

...implementing  a  piece  of  research  requires  a 
judgment  about  the  future  and  how  it  will  be 
modified  by  the  research  findings.  The  judgment 
is  subject  to  error,  which  increases  the  further 
one  peers  into  the  future.  It  must  be  recognized 
that  they  are  considered  judgment,  but  not  neces¬ 
sarily  the  truth  1176:1261. 


After  the  decision  maker  or  group  of  experts  have 
applied  the  criteria  to  the  subset  of  technology  issues  and 
reviewed  the  results,  it  is  important  that  some  sensitivity 
analysis  be  performed  on  the  final  solution.  This  is  neces¬ 
sary  to  test  its  stability  and  to  better  interpret  the 
solution  in  the  context  of  imperfect  information. 

One  of  the  first  things  the  decision  maker  must  deter¬ 
mine  is  the  relative  stability  of  his  assessment.  In  this 
case  the  weightings  for  the  planning  horizons  and  the 
weightings  for  the  criteria  can  be  manipulated  to  check 
whether  or  not  the  final  solution  is  sensitive  to  small 
changes  in  these  weightings.  If  the  solution  is  not  sensi¬ 
tive  to  smal 1  or  medium  changes  in  these  weightings  then  the 
decision  maker  should  be  more  confident  in  the  solution. 
However,  if  the  solution  is  unstable  then  he  must  perform 
further  analysis  in  order  to  increase  the  confidence  in  the 
final  solution.  This  can  only  be  done  by  gathering  further 
information  and  redoing  the  assessment. 

Also,  the  decision  maker  can  test  whether  or  not  a 
particular  criterion  is  important.  In  other  words,  if  the 
final  weighted  priority  list  shows  no  significant  differen¬ 
tiation  between  the  technology  issues  under  one  criterion, 
then  this  criterion  does  not  add  information  and  hence  can 
be  dropped  for  that  particular  set  of  technology  issues.  In 
other  words,  if  all  technology  issues  score  about  equally 
with  respect  to  a  given  criterion,  then  that  criterion  will 
be  judged  unimportant  by  most  decision  makers.  Such  a 


criterion  does  not  help  in  making  a  decision  £288:1873. 
Identifying  unimportant  criteria  would  also  help  reduce  the 
time  and  complexity  of  further  sensitivity  analysis. 


With  better  information,  some  of  the  individual  assess¬ 
ments  made  in  the  pairwise  comparisons  using  AHP  will 
probably  change.  A  reassessment  will  obviously  need  to  be 
done.  The  solutions  can  then  be  compared  to  determine 
whether  or  not  the  priorities  and  rankings  of  the  technology 
issues  have  changed  and  by  how  much. 
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The  -final  element  o-f  the  decision  support  methodology 
is  the  user  interface.  This  section  describes  our  percep¬ 
tion  of  those  requirements  that  are  needed  to  transform  our 
proposed  decision  support  methodology  into  an  actual  comput¬ 
er-based  decision  support  system.  The  actual  user  interface 
would  most  likely  be  a  computer  terminal  whereby  the  deci¬ 
sion  maker  or  space  technology  expert  can  interface  with 
both  the  database  and  the  analytical  tool  with  the  appro¬ 
priate  algorithms.  The  intent  in  this  section,  therefore, 
is  to  define  the  general  features  that  a  computer-based 
decision  aid  must  have  if  a  truly  effective  user  interface 
is  to  be  achieved. 

The  computer-based  decision  aid  for  space  technology 
advocacy  should  be  microcomputer  based.  The  microcomputer 
is  an  economical  and  effective  means  of  processing  the 
management  information  needed  to  arrive  at  informed  deci¬ 
sions  about  space  technologies.  Lee  1105:239-2411  and  Keen 
and  Morton  1136:41  list  several  reasons  for  choosing  the 
mi crocomputer  as  the  vehicle  for  decision  support.  We  ex¬ 
pand  on  these. 

First,  the  mi crocomputer-based  decision  aid  is  "user- 
friendly"  in  the  sense  that  the  decision  maker  does  not  need 
professional  programming  skills.  In  other  words,  the  deci¬ 
sion  maker  can  interact  directly  with  the  mi crocomputer  to 
obtain  decision  support. 

The  second  reason  for  basing  this  decision  support  aid 
on  the  mi crocomputer  is  the  availability  of  improved  soft- 
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ware. 


Highly  interactive  sa-ftware  packages  exist  that 


require  very  little  training  to  operate  effectively.  For 
example.  Expert  Choice  is  an  excellent  sample  of  a  user 
friendly  and  interactive  software  package.  Appendix  D  is  a 
copy  of  printout  from  Expert  Choice. 

A  third  reason  for  choosing  mi crocomputers  is  the 
increasing  managerial  computer  fluency.  In  other  words, 
with  the  explosion  in  the  availability  of  mi crocomputers, 
the  new  generation  of  space— technol ogy  experts  and  managers 
will  bring  with  them  an  increased  awareness  of  computers  and 
management  science.  Also,  with  this  increased  fluency, 
these  decision  makers  will  be  able  and  willing  to  use  micro¬ 
computers  to  aid  in  decision  making. 

Fourth,  the  Air  Force  has  and  is  currently  providing 
mi crocomputers  to  many  offices.  For  example,  the  Space 
Technology  Center  currently  has  several  mi crocomputers  that 
could  run  the  algorithms  described  in  this  chapter. 

Another  important  reason  for  using  mi crocomputers  is 
that  mi crocomputers  are  constantly  improving.  In  this 
respect,  improvements  in  speed  and  storage  capabilities  will 
allow  expansion  of  the  database  and  will  also  allow  the 
expansion  of  this  advocacy  model  to  provide  additional 
capabilities  (such  as  graphics  capabilities). 

The  low  cost  and  small  size  of  mi crocomputers  means 
that  other  space  technology  advocates  could  gain  easy  access 
to  this  model  and  the  database.  This  decision  support  tool 
is  designed  with  the  Space  Technology  Center  in  mind.  How- 
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ever,  i-f  similar  staff  functions  within  other  major  commands 
desire  it,  they,  too,  could  use  this  space  technology  advo¬ 
cacy  model  in  their  planning  functions.  The  database  and 
the  software  model  could  be  made  readily  available. 

A  final  reason  for  using  mi crocomputers  is  that  it 
would  be  easy  to  add  new  management  science  models  to  the 
decision  support  system  in  order  to  evaluate  alternative 
approaches  to  the  space  technology  advocacy  problem.  In 
other  words,  as  the  decision  support  model  expands,  new 
features  could  be  added.  For  example,  a  CPM  or  PERT  model, 
or  even  GANTT  chart  software  packages  could  be  added,  and 
easily  integrated  into  the  current  decision  support  package. 
Also,  sophisticated  statistical  subroutines  could  be  incor¬ 
porated  into  the  decision  support  methodology  that  are 
specifically  designed  for  analysis  of  group  results  C18j  64; 
65;  77;  1803 

To  provide  program  control,  database  control,  error 
protection  and  user  assistance,  we  now  list  several  common- 
sense  features  (partially  derived  from  Keen  and  Morton 
C1363)  that  a  computer-based  decision  support  system  must 
have  if  the  user  interface  is  to  be  effective  and  efficient: 

1.  Protection  against  premature  program  termina¬ 
tion  due  to  user  input  errors. 

2.  The  program  must  be  able  to  recover  from  input 
errors  without  starting  over. 

3.  Ability  to  selectively  display  or  modify  user 
inputs. 

4.  Ability  to  provide  help  to  the  user  at  any 
time,  especially  when  the  user  is  unfamiliar  with 
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the  system. 

5.  Ability  to  selectively  list  the  options  avail¬ 
able  to  the  user  whenever  needed. 

6.  Ability  to  stop  the  program  and  restart  it 
later  without  losing  any  data  that  has  already 
been  entered. 

7.  Ability  to  abort  a  routine  without  terminating 
the  entire  program. 

B.  Ability  to  control  the  overall  flow  of  the 
program  with  as  little  effort  as  possible. 

9.  Ability  to  provide  unique  display  algorithms 
as  well  (see  C167;  268;  269;  270;  271;  2721) 

In  summary,  the  mi crocomputer  and  user  friendly 
software  provide  an  excellent  vehicle  to  interface  the  deci¬ 
sion  maker  with  this  proposed  decision  support  methodology. 


Conclusions 


The  outcomes  obtained  from  various  models  used 
must  now  be  interpreted  in  the  light  of  practical, 
real— world  considerations.  A  solution  to  a  prob¬ 
lem  that  has  been  simplified  and  possibly  made 
amenable  to  calculation  by  idealization  and  aggre¬ 
gation  is  not  necessarily  a  good  solution  to  the 
original  problem.  Even  if  the  model  and  its 
inputs  are  excellent,  the  conclusions  proposed  may 
still  be  unacceptable  C189:59J. 

Up  to  this  point  we  have  only  discussed  some  of  the  key 
elements  in  our  space  technology  advocacy  model  (Figure  6- 
10).  The  four  elements  we  have  discussed  (criteria,  infor¬ 
mation  requirements,  analytical  tools,  user  interface) 
provide  the  decision  maker  with  a  worth  assessment  of  space 
technology  issues.  After  the  space  technology  assessments 
are  made  the  decision  maker  must  consider  external  factors 
before  he  presents  his  space  technology  plan.  We  define 
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Figure  6-10.  Space  Technology  Advocacy  Model 


external  -factors  as  those  exogenous  variables  beyond  the 
control  of  the  decision  maker.  We  discussed  some  of  these 
factors  in  Chapter  Four. 

For  example,  to  the  extent  that  people  agree  about  the 
importance  of  the  technology  issues,  more  resources 
(funding)  should  be  advocated  for  those  technology  issues. 
To  the  extent  that  people  disagree  about  the  importance, 
their  judgments  tend  to  nullify  each  other  and  the  technol¬ 
ogy  issue  tends  to  get  a  smaller  share  of  the  emphasis  in 
the  advocacy  process.  If  a  technology  issue  is  important  to 
the  strategy  of  space  technology,  but  there  is  disagreement 
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on  implementation,  i.e.  the  manner  in  which  the  technology 
issue  should  be  advocated,  then  more  information  should  be 
gathered  so  that  the  experts  and  the  decision  makers  develop 
a  better  appreciation  for  the  need  to  resolve  the  technology 
issue  and  can  thus  induce  more  cohesive  action. 

Other  external  factors  that  the  decision  maker  must 
consider  are  policies,  other  advocates,  the  number  of  ex¬ 
isting  programs  that  already  address  a  particular  technology 
issue,  laboratory  resources  and  personnel,  and  national  and 
organizational  politics. 

The  next  chapter  presents  the  results  of  applying 


elements  of  our  proposed  decision  support  methodology  to  the 
worth  assessment  of  space  technology  issues. 


VII. 


Testing  of  the  Space  Technology  Advocacy 
Decision  Support  Methodology 


Introduction 

The  previous  chapter  discussed  the  three  elements  o-f  a 
decision  support  system:  in-formation,  analytical  tools,  and 
user  interface.  Also,  the  specific  elements  that  would  go 
into  a  decision  support  system  for  space  technology  advocacy 
were  identified  and  discussed.  However,  the  description  of 
the  elements  of  a  decision  support  system  is  insufficient  to 
determine  the  suitability  and  user  acceptance  of  the  system. 
In  fact,  it  is  necessary  to  address  four  general  problems 
C24j  159:13  that  determine  whether  or  not  a  particular 
decision  support  methodology  will  be  adopted.  The  first 
problem  involves  the  degree  to  which  the  methodology  fits 
the  reality  of  the  decision  situation.  The  second  involves 
the  availability  or  lack  of  acceptable  input  data  or  infor¬ 
mation  for  use  by  the  expert  or  decision  maker  in  order  to 
make  informed  judgments  or  decisions.  The  third  problem 
involves  the  familiarity  with  or  the  lack  of  familiarity  and 
knowledge  of  the  techniques  used  in  the  decision  support 
methodology.  The  final,  and  perhaps  the  most  crucial  prob¬ 
lem  involves  the  organizational  stability  necessary  for  the 
continued  acceptance  and  use  of  a  methodology. 

We  conducted  an  exercise  to  determine  the  suitability 
and  acceptability  of  our  proposed  methodology.  We  were  also 
interested  to  learn  how  well  our  methodology  addressed  the 
four  problems  listed  above.  We  hoped  to  gain  insight  into 
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the  impact  and  possible  adoption  o-f  the  methodology. 

Eight  people  participated  in  the  exercise.  All  o-f 
these  participants  are  involved  to  some  degree  in  the  eval¬ 
uation  o-f  space  technology  issues  either  at  the  laboratory 
level  (AF  Wright  Aeronautical  Laboratories  with  two  partici¬ 
pants)  or  at  the  technology  planning  level  (AF  Space 
Technology  Center  with  six  partici pants) . 

Demographic  data  is  provided  in  Appendix  K  to  show  the 
broad  cross  section  this  group  of  eight  people  represent. 
Appendix  L  is  a  copy  of  the  instructions  provided  to  each  of 
the  participants  in  the  exercise.  Appendix  M  is  the  inter¬ 
view  schedule  (questionnaire)  that  each  participant 
completed  after  they  finished  the  exercise.  Appendix  N  is 
the  list  of  space  technology  issues  that  were  evaluated  by 
the  participants.  Appendix  0  is  an  example  of  the  listing 
of  the  re suits  of  using  the  AHP  in  evaluating  the  space 
technology  issues,  including  example  histograms  of  the  pair¬ 
wise  comparisons.  The  reader  should  refer  to  these 
appendices  for  the  actual  details  of  the  exercise.  The 
results  of  the  part i ci pants’  weighting  of  the  space  technol¬ 
ogy  issues  are  not  provided.  Again,  the  purpose  of  the 
exercise  was  not  to  prioritize  space  technology  issues  but 
rather  to  gain  some  insight  into  the  methodology  itself. 
However,  the  responses  to  the  questionnaire  are  provided  and 
discussed  below  and  are  more  appropriate  for  addressing  the 
four  problem  areas  discussed  above. 


Cbiectives  of  the  Exercise 

The  objectives  of  the  exercise  were  to  investigate  the 
validity,  adequacy,  suitability,  and  usefulness  o-f  our  pro¬ 
posed  methodology.  All  but  two  of  the  participants  used  the 
commercially  available  computer  software  Expert  Choice  (see 
Chapter  6)  when  evaluating  the  space  technology  issues. 
Another  objective  of  the  exercise  was  to  determine  the  "user 
friendliness"  of  this  type  of  software.  Other  objectives  of 
the  exercise  were  to  obtain  from  the  participants  their 
responses  in  such  areas  as  their  understanding  of  what  they 
were  to  do;  their  assessment  of  their  own  qualifications  to 
evaluate  space  technology  issues;  their  familiarity  with 
analytical  techniques;  the  suitability  of  the  hierarchical 
model  used  in  the  exercise;  the  importance  of  consistency  in 
making  decisions;  the  availability  of  information  for  eval¬ 
uating  space  technology  issues  with  respect  to  the  criteria; 
the  "reasonabl eness"  of  the  results  of  their  evaluation;  and 
finally,  their  inclination  as  to  adopting  the  methodology 
for  the  evaluation  of  space  technology  issues. 

Questionnaire  Responses 

The  responses  to  the  questionnaire  as  to  the  overall 
appropr i ateness  of  cur  proposed  methodology  are  now  pre¬ 
sented.  No  statistical  tests  are  employed  in  the  fallowing 
analysis.  These  would  be  i nappropr i ate  given  our  small 
sample  size.  However,  the  relevant  data  has  been  compiled 


and  presented  in  the  form  of  a  frequency  distribution. 


Conclusions  drawn  from  this  data  are  based  on  a  qualitative 


evaluation  o-f  the  responses  combined  with  our  observations 
and  experiences  in  conducting  the  exercise.  Fallowing  each 
frequency  distribution,  a  conclusion  is  made,  followed  by  a 
short  discussion. 

Understanding. 

Objective:  The  objective  of  the  following  question  was  to 
determine  whether  or  not  the  participants  understood  the 
purpose  of  the  exercise  and  the  part  they  were  to  play  in 
it.  In  effect,  this  question  addressed  whether  cr  not  the 
participants  understood  what  they  were  supposed  to  do. 


G:  I  understood  what  I  was  required  to  do  for  this  exercise 


in  assessing  the  space  technology  issues. 


not  at  all  clear 
not  very  clear 
somewhat  clear 
fairly  clear 
very  clear 


X  X 
X 

X  X  X  X  X 


I 

Conclusion:  Most  of  the  participants  had  a  clear  under¬ 

standing  of  what  was  involved  in  this  exercise. 


Discussion:  The  two  participants  that  responded  that  they 
did  not  have  a  clear  understanding  were  the  two  participants 
that  had  never  actually  prioritized  technology  issues  pre¬ 
viously.  Hence,  they  showed  some  hesitancy  in  actually 
evaluating  space  technology  issues,  especially  those  that 
were  outside  their  field  of  expertise.  Also,  we  observed  a 
definite  learning  curve  phenomenon  in  all  of  the  partici- 


pants.  Seme  learned  how  to  use  the  software  more  rapidly 
than  others.  However,  the  rapidity  at  which  a  participant 
"learned"  the  methodology  did  not  appear  to  affect  his 
response  to  this  question.  Overall,  we  feel  that  all  of  the 
participants  understood  what  was  expected  of  them.  None  of 
the  participants  showed  any  reluctance  for  expressing  his 
preferences  in  the  pairwise  comparison  of  technology  issues. 
Sual i f i cat i on . 

Objective:  The  objective  of  the  following  four  questions 

was  to  elicit  the  parti ci pants'  feelings  as  to  their  quali¬ 
fications  to  evaluate  space  technology  issues  in  and  out  of 
their  area(s)  of  expertise. 

Q:  I  feel  qualified  to  assess  technology  issues  outside  my 

area(s)  of  expertise. 

strongly  disagree 

disagree  X  X  X  X 
not  sure  X 

agree  XXX 
strongly  agree 

Q:  I  feel  qualified  to  assess  technology  issues,  outside  my 

area  of  expertise  in  terms  of  the  three  criteria. 

strongly  disagree 

disagree  XXX 
not  sure  XXX 
agree  X  X 
strongly  agree 


0:  I  feel  qualified  to  use  these  three  criteria  in  as¬ 

sessing  space  technology  issues. 

strongly  disagree 
di sagree 
not  sure 

agree  X  X  X  X  X  X  X 
strongly  agree  X 


Q:  I  feel  qualified  to  assess  technology  issues  in  terms  of 

military  doctrine. 

strongly  disagree 

disagree  X 
not  sure  X 

agree  X  X  X  X  X 
strongly  agree  X 


Conclusion:  The  respondents  in  general  felt  qualified  to 
evaluate  space  technology  issues  in  terms  of  the  criteria. 
However,  only  those  who  described  themselves  as  "multidisci¬ 
plinary"  felt  comfortable  evaluating  space  technology  issues 
across  disciplines. 


Discussion:  The  more  experienced  participants  responded 
more  favorably  across  the  board  to  all  four  questions.  Some 
of  the  less  favorable  responses  could  be  explained  in  terms 
of  some  misunderstanding  as  to  the  actual  definition  and 
explanation  of  each  of  the  criteria. 

Analytic  Techniques. 

Objective:  The  objective  of  the  following  four  questions 
was  to  obtain  from  the  participants  in  the  exercise  an 
indication  of  their  familiarity  with  the  analytic  hierarchy 
process,  other  analytical  techniques,  and  their  use  of  these 


techniques  in  setting  priorities  in  any  aspect  o-f  their 
professional  lives. 


Q:  Were  you  -familiar  with  the  Analytic  Hierarchy  Process 

prior  to  this?  Indicate  the  level  o-f  -familiarity  on  the 
-following  scale. 

Not  at  all  1  XX 

2  XX 

3  X 

Somewhat  4  XX 


Very  Much  7 


Q:  Have  you  ever  used  the  Analytic  Hierarchy  Process  as  an 

aid  for  selecting  or  assessing  possible  alternatives  (in  any 
aspect  of  your  job  or  profession)? 

Not  at  all  1  XXXXX 

2  XX 

3 

Somewhat  4 

5 

6 

Very  Much  7  X 


Q:  Do  you  currently  use  any  formal ized  method  or  technique 

for  assessing  or  prioritizing  technology  issues? 


Yes  XXX 
No  XXXXX 


Q:  I  am  now  using  or  have  used  quantitative  analytical 

methods  in  my  work  for  setting  priorities. 

much  too  little  X  X  X 

too  little  XXX 

about  right  X  X 
too  much 
much  too  much 


Conclusion:  Most  participants  were  un-familiar  with  the  AHP 
but  knew  o-f  methods  using  pairwise  comparisons.  Also,  most 
of  the  participants  do  not  use,  or  use  only  rarely,  any 
formal  analytical  techniques  for  setting  priorities  or  for 
evaluating  space  technology  issues. 

Discussion:  Only  one  of  the  participants  used  a  method  of 
pairwise  comparisons  regularly,  although  it  was  unclear  if 
the  AHP  was  the  methodology  he  used.  Other  than  this  single 
person  all  of  the  other  participants  wanted  to  use  analyti¬ 
cal  techniques  but  were  unsure  of  which  ones  were  suitable 
and  also  how  to  "implement"  them  in  their  work. 

Consi stencv. 

Objective:  The  objective  of  the  following  two  questions  was 
to  elicit  from  the  participants  an  indication  of  whether  or 
not  consistency  in  their  decisions  was  important  to  them  and 
whether  or  not  the  measure  of  their  consistency  in  evalua¬ 
ting  space  technology  issues  was  a  valuable  aid  to  them  when 
they  used  the  AHP  to  evaluate  these  space  technology  issues. 

Q:  The  measure  of  my  consistency  in  setting  space  technol¬ 


ogy  issue  priorities  is  an  important  element  in  using  this 
approach. 


Q:  Consistency  is  important  to  me  when  making  decisions. 

strongly  disagree 
disagree 

not  sure  XXX 
agree  XXX 
strongly  agree  X  X 

Conclusion:  In  general  the  participants  thought  consistency 

was  important,  but  not  overly  so. 

Discussion:  All  of  the  participants  used  the  measure  of 

their  consistency  as  calculated  using  the  AHP  to  determine 
if  their  pairwise  comparisons  were  relatively  consistent. 
However,  some  of  the  participants  did  not  really  understand 
what  consistency  meant.  Others  who  did  understand  did  not 
seem  overly  concerned  with  making  their  choices  more  consis¬ 
tent.  The  best  use  of  the  consistency  index  was  to  identify 
possible  mi  sentries.  Overall,  practically  all  of  the 
participants  were  very  consistent  (less  than  0.10  inconsis¬ 
tency  index)  at  evaluating  the  technology  issues  with 
respect  to  the  criteria.  If  a  participant  was  inconsistent 
it  was  in  the  pairwise  comparison  of  planning  horizons  with 
respect  to  the  goal  and  in  the  pairwise  comparison  of  the 
criteria  with  respect  to  the  planning  horizon.  Many  of  the 
participants  were  indecisive  in  setting  these  priorities. 

Model . 

Objective:  The  objective  of  the  following  question  was  to 

obtain  from  the  participants  in  the  exercise  an  indication 
of  the  validity  of  the  hierarchical  model  employed  in  the 
evaluation  of  the  space  technology  issues. 


Q: 


The  hierarchy  is  appropriate  for  this  type  of  analysis. 


strongly  disagree 
disagree 
not  sure 
agree 
strongly  agree 


X 

X 

X  X  X  X  X 
X 


Conclusion:  As  a  simple,  standardized  model  with  which  to 
evaluate  the  methodology  the  model  was  good. 

Discussion:  All  of  the  participants  questioned,  to  one 
degree  or  another,  the  model  used  to  evaluate  the  technology 
issues.  However,  all  participants  were  able  to  make  the 
comparisons  and  trade-offs  necessary  to  evaluate  the  tech¬ 
nology  issues.  On  the  other  hand,  we  strongly  urge,  and  the 
participants  agreed  with  us,  that  the  actual  hierarchical 
model  should  be  created  by  the  decision  maker  to  reflect  his 
goals,  objectives,  criteria,  and  decision  situation.  Over¬ 
all,  the  participants  thought  the  model  was  adequate  for  the 
intended  purpose. 

Goal . 

Objective:  The  objective  of  the  following  four  questions 
was  to  obtain  from  the  participants  in  the  exercise  an 
indication  as  to  the  ultimate  goal  for  resolving  space 
technology  issues. 
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Q:  The  ultimate  goal  for  resolving  space  technology  issues 

is  to  provide  a  broad  technology  base  to  meet  current  and 

•future  operational  needs. 

strongly  disagree 
di sagree 
not  sure  X  X 

agree  X  X  X  X  X 

strongly  agree  X 


Q:  The  ultimate  goal  for  resolving  space  technology  issues 

is  to  provide  a  broad  technology  base  that  is  responsive  to 

operational  needs. 

strongly  disagree  X 
disagree  X 
not  sure  X 

agree  X  X  X  X  X 
strongly  agree 


Q:  The  ultimate  goal  for  resolving  space  technology  issues 

is  to  provide  a  broad  technology  base  that  is  responsive  to 
operational  needs  currently  known,  projected,  or  as  yet 
unidentified. 

strongly  disagree  X 
disagree 
not  sure  X 
agree  X  X 

strongly  agree  X  X  X  X 


Q:  The  ultimate  goal  for  resolving  space  technology  issues 

is  to  build  space  systems. 

strongly  disagree  X 

disagree  X  X  X  X  X 
not  sure 

agree  X  X 
strongly  agree 


Conclusion:  The  participants  expressed  many  opinions  as  to 


the  ultimate  goal  -for  resolving  space  technology  issues. 

Discussion:  Many  opinions  were  expressed  and  good  arguments 

presented  to  support  those  opinions.  A  comprehensi ve  state¬ 
ment  o-f  the  goal  would  be  multidimensional  in  nature  and  be 
a  mul t i perspect i ve  definition. 

Cr i teri a. 

Objective:  The  objective  o-f  the  following  four  questions 

was  to  obtain  from  the  participants  in  the  exercise  an 
indication  of  their  understanding  of  the  criteria,  the 
appropr i ateness  of  using  these  criteria  in  evaluating  space 
technology  issues,  and  whether  or  not  the  participants  could 
actually  evaluate  the  space  technology  issues  with  respect 
to  each  of  the  criteria. 

Q:  The  three  criteria  represent  a  good  way  to  evaluate  the 

potential  military  strategic  and  technical  utility  of  space 

technology  issues. 

strongly  disagree 
di sagree 
not  sure  X 

agree  X  X  X  X  X  X  X 
strongly  agree 

Q:  Technology  issues  need  to  be  assessed  and  prioritized  in 

the  context  of  the  three  criteria. 

strongly  disagree  X 
di sagree 

not  sure  X  X  X  X 
agree  XXX 
strongly  agree 


Q: 


Of  the  three  criteria,  which  one  was  easiest  to  apply? 


Criteria  1 
Criteria  2 
Criteria  3 


X  X  X  X  X  X 
X  X 


Q:  Of  the  three  criteria,  which  one  was  most  difficult  to 

apply? 


Criteria  1 
Criteria  2 
Criteria  3 


X 

X  X 

X  X  X  X  X 


Conclusion:  The  criteria  are  "good"  ones  to  use  in  the 

evaluation  of  space  technology  issues. 


Discussion:  All  of  the  participants  expressed  some  concern 

over  the  "fuzziness"  of  the  criteria.  However,  we  observed 
that  none  of  the  participants  were  unable  to  make  the  pair¬ 
wise  comparisons  required  with  respect  to  each  of  the 
criteria.  We  also  noted  that  much  discussion  was  generated 
concerning  what  was  meant  by  each  of  the  criteria.  We  think 
this  could  be  a  valuable  organizational  aid  in  better 
defining  goals  and  objec  ves  that  are  ill— defined.  Most 
participants  thought  criterion  1  was  the  easiest  to  apply 
because  they  were  most  familiar  with  meeting  mission  re¬ 
quirements.  On  the  other  hand,  some  of  the  participants 
were  uncomfortable  with  the  third  criterion  because  they  did 
•  not  know  how  to  measure  a  "hedge"  against  technol ogi cal 

surprise  or  uncertainty.  There  was  some  correlation  with 


age/experience  and  the  level  of  comfort  with  using  Criterion 
3.  Those  older  and  more  experienced  had  less  difficulty 


applying  Criterion  3. 
Criterion  1. 
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Dbjective:  The  objective  of  the  following  two  questions  was 
to  obtain  from  the  participants  in  the  exercise  an  indica¬ 
tion  of  their  understanding  of  the  first  criterion  and  their 
ability  to  apply  it  in  the  pairwise  comparison  of  space 
technology  issues. 


Q:  The  description  of  Criterion  1  made  sense  to  me. 

strongly  disagree 
disagree 
not  sure 

agree  X  X  X  X  X  X 

strongly  agree  X  X 

0:  I  was  able  to  apply  Criterion  1  in  the  pairwise 

comparison  of  space  technology  issues. 

strongly  disagree 

disagree  X 
not  sure 

agree  X  X  X  X  X  X  X 
strongly  agree 

Conclusion:  Criterion  1  was  suitably  defined  and  applied. 


Discussion:  Most  participants  readily  understood  this 
criterion  and  only  one  person  had  problems  applying  it. 
However,  we  must  point  out  that  this  person  was  also  the 


least  experienced  of  all  the  participants  (second 
1 i eutenant ) . 

Criterion  2. 

Objective:  The  objective  of  the  following  two  questions  was 

to  obtain  from  the  participants  in  the  exercise  an  indica- 


tion  o-f  their  understanding  o-f  the  second  criterion  and 
their  ability  to  apply  it  in  the  pairwise  comparison  o-f 
space  technology  issues. 

Q:  The  description  o-f  Criterion  2  made  sense  to  me. 

strongly  disagree 
disagree 
not  sure 

agree  X  X  X  X  X 
strongly  agree  XXX 

Q:  I  was  able  to  apply  Criterion  2  in  the  pairwise  compar¬ 

ison  of  space  technology  issues. 

strongly  disagree 
disagree 
not  sure 

agree  X  X  X  X  X  X  X 
strongly  agree  X 

Conclusion:  This  criterion  was  suitably  defined  and  ap¬ 

plied. 

Discussion:  The  participants  understood  this  criterion  and 

could  apply  it  to  the  various  technology  issues.  However, 
two  of  the  participants  felt  that  they  would  have  to  do 
further  research  on  several  of  the  technology  issues  before 
they  would  be  willing  to  make  an  "honest"  evaluation.  In 
the  same  vein,  both  of  these  participants  did  indicate  that 
the  information  for  this  type  of  evaluation  was  available  in 
the  MSSTP  and  in  other  technical  reports. 

Criterion  5. 

Objective:  The  objective  of  the  following  two  questions  was 

to  obtain  from  the  participants  in  the  exercise  an  indica- 
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tion  o-F  their  understandi ng  o-f  the  third  criterion  and  their 
ability  to  apply  it  in  the  pairwise  comparison  o-f  space 
technology  issues. 


Q:  The  description  of  Criterion  3  made  sense  to  me. 

strongly  disagree 
disagree 
not  sure  X  X 

agree  X  X  X  X 

strongly  agree  X  X 

Q:  I  was  able  to  apply  Criterion  3  in  the  pairwise  compari¬ 

son  of  space  technology  issues. 

strongly  disagree 
disagree 

not  sure  XXX 
agree  X  X  X  X 

strongly  agree  X 

Conclusion:  Criterion  3  is  the  "fuzziest"  criterion  and  the 

most  difficult  to  apply,  but  not  overly  so. 

Discussion:  All  participants  had  questions  for  us  about 

this  criterion.  However,  again  none  of  the  participants 
showed  any  reluctance  to  make  the  pairwise  comparisons  using 
Criterion  3.  All  of  the  participants  agreed  that  it  would 
be  difficult  if  not  impassible  to  quantitatively  describe 
this  criterion.  The  method  of  pairwise  comparisons  used  in 
the  AHP  as  well  as  the  verbal  scale  seemed  to  allow  each  of 
the  participants  to  make  the  evaluations. 

Inf ormati on. 

Objective:  The  objective  of  the  following  four  questions 


was  to  obtain  from  the  participants  in  the  exercise  an 


indication  of  the  existence  and  the  availability  of  informa¬ 
tion  that  could  be  used  by  the  expert  or  decision  maker  in 
evaluating  the  various  space  technology  issues  in  a  pairwise 
fashion . 


Q:  The  information  required  for  this  type  of  analysis  does 

not  currently  exist. 

strongly  disagree  X 

disagree  X  X  X  X  X  X 
not  sure 

agree  X 
strongly  agree 


Q:  The  information  available  to  me  about  the  space  technol¬ 

ogy  issues  is  adequate  for  this  type  of  assessment  in  the 
context  of  criterion  1. 

strongly  disagree 

disagree  X  X 
not  sure  X 

agree  XXX 
strongly  agree  X  X 


Q:  The  information  available  to  me  about  the  space  technol¬ 

ogy  issues  is  adequate  for  this  type  of  assessment  in  the 
context  of  criterion  2. 

strongly  disagree 

disagree  X  X 
not  sure  X 

agree  XXX 
strongly  agree  X  X 
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Q:  The  in-formation  available  to  me  about  the  space  technol¬ 
ogy  issues  is  adequate  for  this  type  o-f  assessment  in  the 
context  o-f  criterion  3. 


strongly  disagree 
disagree 
not  sure 
agree 
strongly  agree 


X  X 
XXX 
X  X 
X 


Conclusion:  The  in-formation 

technology  issues  with  respect 


necessary  to  evaluate  space 
to  the  three  criteria  exists. 


Discussion:  Those  who  were  most  experienced  and  -familiar 
with  space  technology  issues  agreed  that  the  in-formation 
exists.  Those  less  -familiar  did  not  know  whether  or  not  the 
in-formation  exists.  We  originally  hypothesized  that  all 
would  agree  that  the  information  exists.  The  MSSTP  would  be 
a  good  place  to  start. 

Resul ts. 

Objective:  The  objective  of  the  following  four  questions 
was  to  obtain  from  the  participants  in  the  exercise  an 
indication  of  the  validity  of  the  results  of  their  pairwise 
evaluation  of  space  technology  issues.  In  other  words,  were 
the  results  reasonable  and  did  the  results  reflect  the 
actual  preferences  of  the  participant. 


r 
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Q:  The  results  of  the  assessment  are  close  to  how  I  would 

rank  order  the  space  technology  issues  in  order  of 

importance. 

strongly  disagree 
disagree 
not  sure  X 

agree  X  X  X  X  X 

strongly  agree  X  X 


Q:  I  feel  that  decisions  made  by  using  this  system  would 

more  closely  reflect  the  attitudes  and  beliefs  of  the  deci¬ 
sion  maker  than  if  I  did  not  use  the  system  and  arbitrarily 
developed  a  scoring  model. 

strongly  disagree  X 
disagree 
not  sure  X 

agree  X  X  X  X  X  X 
strongly  agree 


Q:  The  results  using  this  approach  are  the  same  that  I 

would  obtain  if  I  did  not  use  this  approach. 

strongly  disagree  ' 

disagree  X 
not  sure  X  X 

agree  X  X  X  X 

strongly  agree  X 


Q:  The  results  using  this  approach  would  be  valuable  in 

setting  priorities  for  budgetary  decisions  for  space  RStD 

technology  programs. 

strongly  disagree 
di sagree 
not  sure  X  X 

agree  X  X  X  X  X 

strongly  agree  X 


Conclusion:  In  general  the  proposed  methodology  and 


criteria  captured  the  space  technology  issue  preferences  of 
the  participants.  The  AHP  is  an  adequate  tool  for  eliciting 
the  preferences  (expert  opinion)  of  decision  makers  and 
space  technology  experts. 

Discussion:  All  of  the  participants  who  had  previously 
prioritized  space  technology  issues  agreed  with  the  final 
ranking  of  the  issues  as  calculated  from  their  pairwise 
comparisons  and  the  hierarchical  model.  However,  all 
participants  were  unsure  of  the  relative  weights  assigned  to 
the  various  levels  within  the  hierarchy.  It  would  be  inter¬ 
esting  to  determine  the  stability  of  individual  preferences 
over  time.  This  could  be  done  by  having  the  expert  make  the 
technology  issue  evaluations  several  times  over  an  appropri¬ 
ate  timespan. 

Adoption. 

Objective:  The  objective  of  the  following  five  questions 

was  to  obtain  from  the  participants  in  the  exercise  an 
indication  of  their  willingness  to  adopt  the  the  AHP  as  a 
part  of  the  organizational  routine  for  prioritizing  space 
technology  issues. 

Q:  I  would  consider  using  this  approach  in  the  future  in  a 

formalized  manner  to  assess  technology  issues. 

strongly  disagree 
di sagree 
not  sure  X 

agree  X  X  X  X  X  X 
strongly  agree  X 


Q:  The  overall  quality  of  my  decisions  would  be  increased 

by  using  this  methodology  because  o-f  the  formalized  struc¬ 
ture  of  the  problem  and  the  criteria  used. 

strongly  disagree 

disagree  X 
not  sure 

agree  X  X  X  X  X  X 
strongly  agree  X 

Q:  This  method  requires  too  much  time  and  effort  to  compare 

and  prioritize  space  technology  issues. 

strongly  disagree  XXX 

disagree  X  X  X  X 
not  sure  X 
agree 
strongly  agree 


Q:  The  manner  in  which  technology  issues  are  currently 

assessed  is  adequate  and  should  not  be  changed. 

strongly  disagree  XXX 

disagree  X  X  X  X  X 
not  sure 
agree 
strongly  agree 


Q:  After  participating  in  this  exercise  I  would  adopt  this 

methodology  and  the  criteria  whenever  I  must  make  an  assess¬ 
ment  of  a  set  of  space  technology  issues. 

strongly  disagree 

disagree  X 
not  sure  XXX 
agree  XXX 
strongly  agree  X 


Conclusion:  Most  participants  would  accept  and  use  the 

proposed  methodology. 


Discussion:  All  of  the  participants  found  the  methodology 


to  be  straight-forward  and  easy  to  apply.  However,  some  were 


concerned  with  our  hierarchical  model  and  the  criteria  we 
used.  We  agreed  that  the  actual  hierarchical  model,  the 
goals,  objectives,  and  criteria  to  be  used  should  be  elic¬ 
ited  -from  the  decision  maker  and  should  re-flect  his  decision 
situation.  Again,  the  most  exciting  result  -from  the 
exercise  was  that  the  simple  model  used  was  adequate  -for 
capturing  the  preferences  of  the  participants.  Complex 
models  may  not  perform  better.  This  would  be  an  interesting 
area  for  further  investigation. 

Summary  and  Overall  Conclusions 

We  must  stress  that  the  results  of  our  exercise  are  not 
statistically  significant.  However,  the  responses  from  the 
eight  participants  are  highly  encouraging  as  to  the  suita¬ 
bility,  adequacy,  usefulness,  and  validity  of  our  proposed 
methodology.  We  feel  that  we  can  make  the  following  gen¬ 
eralizations  concerning  the  proposed  methodology. 

First,  the  hierarchical  model  and  the  method  of  pair¬ 
wise  comparisons  (the  AHP)  are  good  tools  for  eliciting  the 
subjective  preferences  of  the  experts.  Corollary  to  -this  is 
that  the  methodology  does  adequately  capture  the  true  pref¬ 
erences  of  these  same  experts. 

Second,  the  interactive  nature  of  the  software  used 
(Expert  Choice)  and  the  presentation  of  results  in  a  "nice" 
way  are  invaluable  in  gaining  the  interest  and  even  enthusi¬ 
asm  of  potential  users. 


Third,  the  information  necessary  to  evaluate  space 
technology  issues  on  the  basis  of  doctrine  and  strategic 
utility  does  currently  exist. 

Fourth,  we  found  that  the  methodology  provides  an 
excellent  tool  for  intra-  and  inter-organizati onal  dialogue 
as  to  the  clarif ication  of  goals  and  objectives  and  reduc¬ 
tion  of  uncertainty.  In  other  words,  the  use  of  and  the 
results  from  the  methodology  stimulated  communication  among 
the  experts.  This  in  itself  can  increase  the  knowledge  and 
information  available  to  the  experts  and  provide  a  vehicle 
for  better  informed  judgments. 

Fifth,  we  found  that  the  assessment  of  technology 
issues  did  not  have  to  depend  on  concept  linkage.  The 
participants  were  able  to  evaluate  and  compare  technology 
issues  according  to  the  three  criteria  presented. 

Sixth,  although  not  directly  investigated,  the  presen¬ 
tation  of  histograms  of  the  pairwise  comparisons  and  the 
group  results  would  be  valuable  aids  in  group  problem 
solving  sessions.  All  of  the  participants  agreed  that  such 
information  would  help  them  make  better  informed  evaluations 
of  space  technology  issues. 

Finally,  we  found  that  the  most  difficult  part  of 
"selling"  this  methodology  would  be  in  educating  the  poten¬ 
tial  users  as  to  the  good  features  and  possible  drawbacks  of 
the  methodology.  However,  we  did  find  that  the  participants 
learned  fairly  rapidly  and  were  able  to  proceed  without  our 
assistance  after  approximately  30  minutes. 


In  summary  we  found  our  proposed  decision  support 
methodology  addressed  the  four  problem  areas  introduced  at 
the  beginning  of  this  chaper.  The  methodology  used  to 
elicit  subjective  judgments  seems  to  fit  the  reality  of  the 
decision  situation.  The  AHF'  technique  for  eliciting  prefer¬ 
ences  was  easily  learned  and  applied  by  all  the  partici¬ 
pants.  Information  needed  to  make  informed  judgments  is 
available  in  the  M3STP  and  elsewhere.  Along  with  this,  the 
methodology  can  serve  to  identify  additional  information 
requirements.  If  available  this  new  information  could  be 
added  to  or  referenced  in  the  MSSTP  database.  Dur  decision 
support  structure  does  not  directly  address  the  fourth  prob¬ 
lem  that  can  impact  organizational  acceptance  and  use  of  a 
methodology.  We  did  not  analyze  nor  speculate  as  to  the 
organizational  stability  of  the  AFSTC.  However,  we  believe 
the  decision  support  structure  that  we  propose  has  the 
flexibility  to  be  applied  in  a  variety  of  organizational 
settings. 

The  next  chapter  presents  our  final  results  and  conclu¬ 
sions.  In  it  we  identify  areas  for  further  research. 
However,  the  methodology  presented  in  the  previous  chapters 
plus  the  results  presented  in  this  chapter  are  highly 
encouraging  and  could  lead  to  direct  implementation  of  a 
decision  support  system  for  use  by  the  Space  Technology 


Advocate. 


VIII.  Recommendations  and  Conclusions 


Do  not  hamper  any  research,  support  heavily 
research  that  has  a  predictable  payoff;  and  reduce 
uncertainty  concerning  the  military  and  strategic 
usabi  1  i  tv  of  other  technology  areas  and  issues 
[187:623. 

Conclusi on s 

We  began  this  research  effort  thinking  that  we  would 
develop  algorithms  to  improve  and  expand  the  capabilities  o-f 
a  computer-based  space  technology  resource  allocation 
(portfolio  selection)  model  called  TRUMP.  TRUMP  used  the 
information  and  database  of  the  MSSTP.  Accordingly,  we 
began  an  indepth  analysis  of  the  MSSTP  and  TRUMP  and  at  the 
same  time  researched  the  available  management  science  liter¬ 
ature  on  R&D  portfolio  selection  models. 

Pram  our  review  of  the  literature  we  discovered  that 
hundreds  of  RS<D  decision  models  exist  but  few  are  currently 
being  used.  We  found  that  these  decision  models  inadequate¬ 
ly  address  the  inherent  risk  and  uncertainty  of  R&D  decision 
situations.  In  addition,  most  of  these  decision  models 
failed  to  include  the  decision  maker  as  an  integral  factor 
in  the  modeling  process.  This,  too,  was  a  factor  in  the  low 
acceptance  rate  of  many  of  the  decision  models  we  re¬ 
searched.  For  example,  TRUMP  was  abandoned  because  decision 
maker  preferences  were  not  considered  in  the  methodology. 
This  naturally  led  us  to  seek  an  alternative  approach  to  the 
space  technology  advocacy  problem.  The  approach  we  took  was 
to  develop,  in  lieu  of  a  decision  model,  a  decision  support 


methodology  that  would  assist  the  decision  maker  in  the 
decision  making  process.  This  entailed  a  comprehensive 
analysis  of  the  space  technology  advocates’  decision  situa¬ 
tion.  We  studied  the  R&D  environment  and  developed  a 
hierarchical  approach  to  modeling  this  environment.  From 
this  we  developed  criteria  that  could  be  used  to  assess  the 
strategic  and  technical  utility  of  space  technology  issues. 
Using  these  criteria  the  decision  maker  can  focus  on  the 
strategic  appreciation  of  the  technology  issues  and  their 
relative  worth  to  military  space  strategy  and  doctrine  and 
military  space  technology. 

Finally,  we  described  the  information  requirements  and 
the  analytical  tool  (the  AHP>  which  could  be  used  by  the 
decision  maker,  with  the  appropriate  user  interface,  to 
apply  the  criteria  in  a  worth  assessment  of  space  technology 
issues.  This  worth  assessment,  in  conjunction  with  an 
appreciation  for  the  external  factors  in  the  decision 
situation,  allows  the  decision  maker  to  develop  a  space 
technology  advocacy  plan  that  is  based  on  doctrine  and  on  an 
appreciation  for  the  strategic  nature  of  the  problem.  This 
decision  process  is  modeled  in  Figure  8-1. 

Finally,  we  conducted  an  exercise  to  test  the  validity, 
suitability,  and  acceptability  of  our  proposed  decision 
support  methodology.  Eight  space  technology  experts  applied 
the  criteria  to  sets  of  space  technology  issues  within  the 
context  of  the  analytic  hierarchy  process.  Their  response 
to  our  proposed  modeling  of  the  space  technology  advocacy 


problem  leads  us  to  conclude  that  we  have  established  a  -firm 
■foundation  for  development  of  our  proposed  methodology  into 


a  microcomputer-based  decision  support  system.  In  addition 
we  reached  some  specific  conclusions. 


Figure  8-1.  Space  Technology  Advocacy  Model 

1.  Although  it  was  impossible  to  determine  if  better 
decisions  result  from  our  model,  we  did  discover  that  the 
participants  in  our  exercise  felt  that  the  quality  of  their 
decisions  would  improve  if  they  structured  the  problem  as  we 
have  and  applied  the  criteria  using  the  AHP. 

2.  Interactive  programming  techniques  increase  the 


value  of  decision  support  systems.  However,  if  our  proposed 


methodology  is  transformed  into  a  computer-based  decision 
support  system,  then  it  is  essential  that  the  decision  maker 
participate  in  the  actual  design  of  the  system.  In  addi¬ 
tion,  the  system  must  be  adaptive  and  developed  in  a  parti¬ 
cipatory  manner. 

3.  The  use  of  the  computer  to  elicit  the  subjective 
judgments  and  preferences  of  space  technology  experts  guar¬ 
antees  that  the  questions  and  results  are  consistently  de¬ 
veloped.  This  standardization  is  important  when  performing 
sensitivity  analysis. 

4.  The  AHP  adequately  captures  the  subjective  judg¬ 
ments  and  preferences  of  the  space  technology  experts. 
Moreover,  the  AHP,  in  the  context  of  a  worth  assessment  of 
space  technology  issues,  creates  a  great  deal  of  information 
in  the  form  of  pairwise  comparisons.  This  information  can 
be  automatically  displayed  to  the  decision  maker  or  a  group 
of  experts  as  an  aid  to  effective  dialogue  within  the  organ¬ 
ization.  Helin  and  Souder  Cl  10:  1593  say  it  best: 

All  evidence  points  to  the  fact  that  where 
they  are  successful,  it  is  because  the  models  and 
formulae  have  somehow  improved  the  organizational 
decision  making  behavior.  That  is,  it  is  not  the 
analytical  or  decision  optimizing  properties  of 
the  models  that  are  of  value.  Rather,  the  bene¬ 
fits  follow  from  the  fact  that  the  "process"  of 
using  the  model  forces  a  conceptual  examination  of 
alternatives  and  decision  premises,  thereby 
creating  important  dialogues  which  may  not  other¬ 
wise  take  place  in  an  organization  C110:159D. 

Recommendati ons 

The  contribution  we  have  made  in  describing  a  decision 


support  model  -for  the  space  technology  advocate  is  only  a 
■first  step  towards  understanding  and  deriving  useful  infor¬ 
mation  for  R&D  planning.  Using  the  conceptual  framework  we 
have  developed,  we  feel  follow-on  analyses  can  be  accom¬ 
plished  to  better  scope  and  define  the  nature  of  space- 
related  military  R&D  processes.  Analyses  could  build  on  the 
techniques  we  have  introduced  to  better  manage  the  subjec¬ 
tivity  and  complexity  inherent  in  R&D  processes.  Further¬ 
more,  given  consensus  on  subjectively  derived  data,  many  of 
the  quantitative  methodologies  that  address  R&D  portfolio 
selection  problems  in  the  literature  may  have  real  utility 
in  application  to  space  R&D  portfolio  selection  decisions. 

Following  are  some  general  areas  worthy  of  further 
research.  Studies  in  these  areas  would  be  logical  exten¬ 
sions  of  the  work  we  have  begun  in  conceptually  modeling 
military  space  R&D  processes. 

1.  Develop  an  interactive  group  decision  making 
analysis  tool  centered  on  the  AHP  with  built-in  computer 
utilities  for  computing  basic  statistics  and  displaying 
histograms  of  group  results.  Explore  its  utility  as  a  means 
to  evaluate  space  technology  issues  in  a  group  environment. 
Some  specific  areas  worthy  of  research  include  its  use  as  a 
mechanism  to  arrive  at  group  consensus,  and  as  a  means  to 
identify  areas  requiring  additional  information  or  research 
(highlighted  by  wide  divergence  in  individual  results).  Our 
research  indicated  this  approach  would  be  most  beneficial  in 
a  group  setting. 


2.  Apply  the  AHP  in  the  context  o-f  mission  area 
analyses.  We  introduced  a  hierarchy  -for  considering  tech¬ 
nology  issues  from  a  mission  needs  perspective  in  Chapter 
Three  and  expanded  on  it  in  Appendix  G.  The  AHP  could  be 
used  to  elicit  worth  assessments  of  the  various  missions  and 
tasks  that  comprise  this  hierarchy.  Additionally,  technol¬ 
ogy  issues  could  be  further  specified  using  the  AHP  and 
criteria  elicited  from  the  decision  maker.  Technology 
issues  could  then  be  prioritized  on  the  basis  of  their 
linkage  to  missions  and  mission  tasks. 

3.  Focus  on  the  subjective  elements  used  as  data 
inputs  for  TRUMP.  Use  the  A HP  to  elicit  probabilities  of 
success,  and  estimates  for  technology  program  schedules  and 
costs.  We  believe  the  AHP  would  be  particularly  useful  in 
deriving  and  evaluating  criteria  for  these  elements  and  help 
reduce  the  area  of  uncertainty  surrounding  these  estimates. 
Perhaps  estimates  solicited  using  the  AHP  would  be  meaning¬ 
ful  inputs  for  quantitative  risk  analyses. 

4.  Explore  "what  if"  analyses  using  other  analytical 
techniques  in  conjunction  with  the  AHP  (to  elicit  subjective 
estimates).  These  analyses  could  include  development  of 
funding  scenarios,  resource  constrained  advocacy  programs, 
and  simulation  studies  to  explore  the  impacts  of  alternative 
R&D  approaches  and  decisions. 

5.  Develop  the  conceptual  decision  support  model  we 
presented  into  a  comprehensive,  micro-computer  based  deci¬ 
sion  support  system.  Such  a  package  should  include 


automated  inter-faces  between  the  analytical  tool  (the  AHP) 


and  the  database  (the  MSSTP) ,  as  well  as  the  algorithms 
necessary  to  present  the  database  information  the  decision 
maker- needs  to  make  his  assessments.  It  could  also  include 
an  interface  to  external  factors  such  as  budget  information, 
other  advocates  for  given  technology  issues,  and  other  data 
useful  to  the  space  technology  advocate  in  preparing  and 
presenting  his  advocacy  plan. 
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Appendix  A:  Selected  Military  Tasks  from  MSSTP 


Table  A-l 


Tasks  Selected  in  Response  to  Strategic  Threat 


To  provide/Ensure 
Capabilities  -for 

Military  Task  Selected 
(Task  Number) 

Tactical  Warning  of 

Warning  of  ballistic  missile 

strategic  attack 

attack  on  CONUS  (1) 

Warning  of  air  vehicle  attack 
on  CONUS  (2) 

Warning  of  space-based  weapon 
attack  on  CONUS  (3) 

Defense  of  CONUS 

Defense  of  CONUS  from  attack  by 
ballistic  missiles  (4) 

Defense  of  CONUS  from  attack  by 
air  vehicles  (5) 

Improvements  of 

Ballistic  missile  accuracy 

strategic  land  and 

enhancement  (6) 

sea— based  offensive 

Dynamic  strategic  force 

force  capabilities 

construction  (7) 

Strategic  aircraft  force 
reconstitution  (S) 

Strategic  aircraft 

penetration  enhancement  (9) 
Communications  for  strategic 
management  (10) 

Countermeasures  against  early 
warning  radars  (11) 
Countermeasures  against  space 
communications  systems  (12) 

Improved  strategic 

Space  weapon  delivery  (13) 

weapon  delivery 

Discriminating  attack 

capability  (14) 

TABLE  A— 2 


Tasks  Selected  in  Response  to  Tactical  Threat 


To  Provide/Ensure 
Capabilities  for 

Military  Task  Selected 
(Task  Number) 

Capability  improve¬ 
ment  by  NATO 

Warning  of  air  vehicle  attack 
on  theater  forces  (15) 

Defense  of  tactical  forces  from 
attack  by  air  vehicles  (16) 
Warning  of  tactical  ballistic 
missile  attack  on  theater 
forces  (17) 

Tactical  target  identification 
and  site  location  (18) 

Defense  of  tactical  forces  from 
attack  by  tactical  ballistic 
missiles  (19) 

Improved  intratheater 
communications  (20) 

Warning /defense  of 
naval  task  force 

Warning  of  air  vehicle  attack  on 
naval  task  force  (21) 

Defense  of  naval  task  force  from 
attack  by  air  vehicles  (22) 

TABLE  A— 3 


Tasks  Selected  in  Response  to  ASAT  and  Space  Threat 


To  Provide/Ensure 
Capabilities  for 

Military  Task  Selected 
(Task  Number) 

Enhancement  of 
satellite  survival 
and  control  of  space 
operations 

Warning  of  air  vehicle  attack  on 
U.S.  space  systems  (23) 

Defense  of  U.S.  space 
systems  (24) 

Hostile  space  systems 
destruction  (25) 

Survival  through 
reconstitution 

! 

Launch  of  U.S.  space  systems  (26) 

Table  B-l 


DoD  Mission  Area/Task  Linkages 


DoD  Major 
Mission  Area 


Covered 
Task  No. 


by  Selected  Military 
(from  Appendix  A) 


100  Strategic  Warfare 

110  Strategic  Offense 

6, 13, 14 

120  Strategic  Defense 

1,2,3,4,5,23,24,25 

140  Strategic  Support 

26 

200  Tactical  Warfare 


210  Land  Warfare 

6, 13, 14 

220  Air  Warfare 

16 

230  Naval  Warfare 

21,22 

240  Theater  Nuclear 

13, 16, 19 

Warf are 

250  Space  Warfare 

23,24,25 

260  Strategic  Mobility 

N/A 

270  Chemical  Warfare 

6,  13 

300  Intelligence  and  Command,  Control,  Communications 

310  Centrally  Managed 

N/A 

Intel 1 i gence 

320  Tactical  Intelligence 

15, 17, 18 

&  Related  Activities 

330  Strategic  C— cubed 

7,8,9, 10 

Programs 

340  Theater  &  Tactical 

20 

Command,  Control 

350  Warfare  Command  and 

No  task 

Control 

360  Defensewide  C-cubed 

No  task 

Program  Support 

370  EW  and  C-cubed 

11,12 

Countermeasures 

Systems 

DoD  Major 
Mission  Area 


Covered  by  Selected  Military 
Task  No.  (-from  Appendix  A) 


i 


400  De-fensewide  Mission  Support 

410  Space  Launch  and 

26 

Orbital  Support 

420  Global  Military 

No  task 

Environmental  Support 

430  Nonsystem  Training 

N/A 

Devices 

440  Technical  Integration 

N/A 

450  Test  and  Evaluation 

N/A 

Support 

500  Science  and  Technology  Programs 

500 

N/A 

Functional  Area 


Functions 


Surveillance  Air  Vehicle  Detection  and  Track 

Ballistic  Missile  Detection  and 
Track 

Nuclear  Detonation  Detection  and 
and  Location 

Space  Vehicle  Detection  and  Track 

Surface  Target  Surveillance  and 
Reconnai ssance 


Communications  I  Communications 


Navigation  Navigation 

Environmental  Environmental 

Monitoring  Monitoring 

Force  Application  Air  Vehicle  Destruction 

Ballistic  Missile  Destruction 
Space  Vehicle  Destruction 
Surface  Target  Destruction 
Electronic  Warfare 

Space  Operations  Space  Activities 

1  Space  Launch 


Appendix  D:  Conceot/Task  Linkages 


The  figure  shown  below  depicts  the  military  tasks 
(derived  in  Volume  I  of  the  MSSTF‘>  necessary  to  support  each 
of  the  concepts  described  in  Volume  II.  The  34  concepts 
shown  are  based  on  the  results  of  the  first  iteration  of  the 
MSSTP  and  this  list  is  no  longer  valid.  It  is  shown  here 
for  demonstration  purposes  only. 


imm— — ■■■■■■nuranoral 


MSBsaaamsanMBmBnagmBwan—KacM— I 

■nn—«nn««  I 

■y-t  iafi  i  ■□■■cwanmi  ■■■■□£!■■— nnaw— I 


"  — cm  ■naangggKMBMKniMw  ■■■■■! 

Boi 


I  ftrVrXttfitKKEttiii&iJ 


wccna] 


iniBnangognaonD 


BJimnBPnDnDBB— 


Ml 


Figure  D— 1.  Cancept/Task  Linkage  in  the  MSSTP 
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Primary  Attitude 

Secondary  Orbit 

Satellite  Pointing  accuracy  and  stability 


Power /Ener 


Information  Processin 


Table  F— 1.  High  Payoff  Space  Technologies 


TECHNOLOGY 


SYSTEM  PAYOFF 


Propulsion 

Low— Thrust  Chemical 
Heavy  Lift  Chemical 
Advanced  Propulsion  Systems 
Electric  Propulsion 


Increased  Payload 
Military  Access  to  Space 
Large  Structures,  OTV 
Maneuver  Capability 


Power 

Long-Life  Batteries 
Advanced  Power  Processing 
High  Voltage  Distribution 
Nuclear  Reactors 


Improved  Specific  Power 
Improved  Survi vabi 1 i ty 
Increased  System 
Capabi 1 i ty 
Reduced  Weight 
Enable  Advanced  Concepts 


Materi al s 

Advanced  Composites  Increased  stiffness 

Improved  Material  Capability  Reduced  Weights 

Survi vabi 1 i ty 


Structures 

Large  Deployable  Antennas  Space  Radars 

Space  Based  Fabrication,  Space  Weapons 

Assembly,  Deployment  Military  Access  to  Space 

Lightweight  Optics 
Hot  Structures 


Information  Processing 

Spacecraft  Processors 

-  Very  High  Speed 

—  Low  Power  Requirements 
On-Board  Data  Processing 
Advanced  Signal  Processors 

-  Bandwidth 
—  A/J  Margin 

Signature  Model  Prediction 
Accuracy 

Image  Processing  System 
Improvements 
Hardened  Components 


FI  ex  i  bl e/Survi vabi e 
Systems 

Autonomous  Spacecraft 
Multimission,  High  Data 
Capacity 

On-Board  Processing 


Table  F-l.  High  Payoff  Space  Technologies  (cont.) 


TECHNOLOGY 


SYSTEM  PAYOFF 


Cryoaeni cs/Thermal  Control 

Active  Cryogenic  Ref rigerators 

-  Lifetime 

—  Thermal  Load 
Passive  Cryogenic  Coolers 

-  Lifetime 

Deployable  Radiators 

-  Specific  Mass 

Weapons 

Laser  Specific  Energy 
Laser  Power 

Laser  Reactant  Space  Storage 
Capabi 1 i ty 
Laser  Beam  Quality 
Pointing  and  Tracking 

Telemetry  and  Communications 

Data  Rates  to  Small,  Mobile 
Terminal s 

K— Band  Technology  for 
Telecommunications 
60  GHz  Technology  for 
Tel ecommun i cati ons 
High  Data  Rate  Crosslinks 
—  Microwave  Technology 

-  Laser  Communications 
High  Performance  Multi -Beam 

Antennas 

High  Power,  High  Efficiency 
Traveling  Wave  Tube 
Ampl i f i ers 


Increased  Orbital  Life 
LWIR  Capability 


Space  Defense 
Advanced  Submarine 
Communications 
Weapon  Feasibility 


High  Accuracy  Wideband 
Links 

Anti -Jam,  LPI  Service 
Nul ling 

Multi-User  Capability 
Survivable  Mission  Data 


Sensors 

Large  Diameter  Mirrors 
Focal  Plan  Detectors 
—  Number  of  Detectors 

-  CCD  Technology 

-  Low  Temperature  Ops 
Contamination  Control  for 

Systems 

Low  Noise  Power  Amplifiers 
for  Radar  Applications 

Navigation.  Guidance,  and  Control 
Pointing  Control  Systems 

-  Accuracy 

-  Stability 
Gyroscope  Life 


High  Resolution,  Scan 
Rate/Light  Weight 
Spat i al /Temporal  Data 
Detection/Track 
Information 

Small  Target  Detection 


Maneuvering  Capability 
Targeting  Capability 
Increased  Life 


Appendix  G:  Mission  Needs  Hierarch 


Introduction 

In  Chapter  Five  we  described  a  hierarchical  model  that 
showed  the  connectivity  between  technology  issues  and 
national  interests.  We  identified  two  separate  paths  for 
evaluating  the  importance  of  technology  issue  support  to 
national  interests.  One  path  led  from  technology  issues 
directly  to  the  scientific-technological  instrument  of 
national  power,  and  then  through  policies  and  objectives  to 
national  interests.  The  second  path  was  through  a  mission 
needs  hierarchy  that  connected  to  the  military  instrument  of 
national  power  and  then  through  policies  and  objectives  to 
national  interests.  We  briefly  summarized  the  elements  of 
this  hierarchy  in  Chapter  Five. 

In  this  appendix  we  expand  our  discussion  of  the 
mission  needs  hierarchy.  We  explain  why  we  think  it  repre¬ 
sents  an  improvement  over  the  hierarchical  structure 
represented  in  TRUMP  and  how  it  could  be  useful  to  the  space 
technology  advocate  in  evaluating  space— rel ated  technology 
issues.  We  then  discuss  the  hierarchy  in  detail,  defining 
the  various  levels  and  the  elements  that  constitute  each 
1 evel . 


Recall  in  Chapter  Three  we  described  how  military  tasks 
that  could  be  performed  in  space  were  derived  in  the  MSSTP. 


Air  Force  doctrine 


as  described  in  AFM  1-1  C61  and  AFM  1-6 


C83,  defined  Air  Force  missions.  They  included  Space  Oper¬ 
ations  as  one  of  nine  primary  Air  Force  missions.  Linder 
Space  Operations  were  three  categories:  space  support,  force 
enhancement,  and  space  defense.  The  MSSTP  used  this  base¬ 
line  in  generating  military  tasks  that  could  be  performed  in 
space.  Twenty  six  tasks  were  identified  (shown  in  Appendix 
A).  Tasks  were  then  linked  to  task  requirements  (func¬ 
tions),  which  were  linked  to  system  concepts.  Technology 
issues  which  needed  to  be  resolved  to  support  concepts  were 
linked  to  concepts  to  complete  the  hierarchy,  as  shown  in 
Figure  G-l. 

[National  Needs,  National  Security  Objectives,  Policies] 

[implicit  in  the  MSSTP] 


DOD  Mission  Areas,  Mission  Arenas 

I 


Figure  G-l.  MSSTP  &  TRUMP  Hierarchy 


We  took  a  slightly  different  approach  in  developing  our 
hierarchy.  As  we  described  in  Chapter  Four,  there  are  many 
facets  to  doctrine.  We  defined  three  categories  of  doc¬ 
trine:  fundamental,  environmental,  and  organizational.  We 


showed  how  the  MSSTP  hierarchy  is  basically  derived  from 
organizational  doctrine,  which  is  what  AFM  1-1  C63  and  AFIi 
1—6  CS3  primarily  represent.  We  defined  organizational 
doctrine  to  be  “beliefs  concerning  how  to  conduct  warfare, 
based  on  current  thinking  and  constrained  by  existing  poli¬ 
cies."  Environmental  doctrine  was  defined  as  "beliefs  about 
how  the  environment  (the  physical  medium  military  forces 
operate  in)  can  be  exploited  to  support  new  tasks  to  accom¬ 
plish  military  objectives."  Environmental  doctrine  is  not 
necessarily  constrained  by  policy,  but  is  closely  linked 
with  technology.  Environmental  doctrine  both  drives  and  is 
driven  by  technology. 

We  propose  that  building  a  mission  needs  hierarchy  on 
the  basis  of  environmental  doctrine  provides  a  better  foun¬ 
dation  from  which  to  evaluate  technology  issues  necessary  to 
support  a  broad-based  R&D  plan  for  the  future.  It  offers 
several  advantages  over  more  restricted  hierarchies  founded 
on  organizational  doctrine.  For  example,  environmental 
doctrine  is  more  "free-wheeling"  and  unconstrained  by  poli¬ 
cies  and  current  thinking.  Thus,  it  is  easy  to  incorporate 
potential  military  tasks  that  possibly  could  be  accomplished 
in  the  operational  environment.  Such  tasks  may  be  prohib¬ 
ited  by  existing  policies  or  laws.  Additionally,  it  focuses 
attention  on  the  environment  in  which  military  operations 
are  conducted,  promoting  more  forward  thinking  about  how  new 
technologies  could  be  applied  to  accomplishing  military 
tasks  in  the  operational  environment.  Finally,  this  linkage 


between  environmental  doctrine  and  technology  is  symbiotic; 
both  mutually  support  one  another  and  the  focus  is  always  to 
the  future  on  new  ways  military  operations  can  be  supported 
by  technology,  or  new  capabilities  that  technology  must 
provide  to  support  environmental  doctrine. 

Me  believe  this  philosophical  basis  is  especially 
applicable  to  military  space  R&D  planning.  The  planning 
horizon  for  R&D  extends  well  into  the  future.  We  have  shown 
that  forecasting  techniques  that  attempt  to  predict  outcomes 
over  five  years  in  the  future  are  historically  inaccurate 
and  probably  will  not  account  for  all  possible  or  even 
likely  futures.  Thus,  techniques  that  are  limited  by  cur¬ 
rent  thinking  will  yield  futures  that  only  make  sense  from  a 
current  perspective  on  the  way  things  are.  On  the  other 
hand,  if  we  incorporate  an  environmental  doctrine  perspec¬ 
tive  in  our  approach  to  forecasting  future  technological 
requirements,  we  help  overcome  this  emphasis  on  current 
thinking  and  broaden  our  scope.  This  allows  us  to  consider 
a  greater  variety  of  possible  futures  and  to  be  more  free 
thinking  in  generating  these  outcomes. 

Note  that  we  have  said  nothing  as  to  how  technology 
issues  should  be  weighted  when  considered  from  an  environ¬ 
mental  doctrine  perspective.  Realistically,  we  would  expect 
any  mission  needs  hierarchy  to  incorporate  both  organiza¬ 
tional  and  environmental  doctrinal  thinking.  Organizational 
doctrine  addresses  known  military  requirements  and  the  R&D 
efforts  necessary  to  provide  these  requirements.  Environ- 


mental  doctrine  attempts  to  speculate  on  potential  applica¬ 
tions  and  possible  exploitations  of  technology  to  support 
military  tasks.  We  would  surmise  that  initially  technology 
issues  generated  -from  an  environmental'  doctrine  perspective 
would  be  weighted  rather  low  against  technology  issues  re¬ 
lated  to  existing  military  deficiencies.  However,  as  a 
particular  environmental  doctrine  gains  acceptance,  then  the 
technology  requirements  to  support  it  increase  in  stature. 
We  believe  it  is  important  to  identify  these  issues  as  soon 
as  possible.  Whether  they  are  weighted  high  initially  is 
not  as  important  as  ensuring  they  are  documented  as  poten¬ 
tial  R&D  benefits. 

We  are  now  ready  to  describe  the  mission  needs  hierar¬ 
chy  we  have  developed  from  an  environmental  doctrine  per¬ 
spective.  However,  we  must  note  some  limitations  up  front. 
First  of  all,  since  our  original  objective  was  to  provide  a 
hierarchical  structure  the  Air  Force  Space  Technology  Center 
could  use  in  their  advocacy  program,  we  had  to  consider 
military  space  R&D  requirements  from  an  Air  Force  perspec¬ 
tive.  In  this  regard,  we  broadly  interpreted  policy 
statements  that  include  space  as  part  of  the  Air  Force 
operational  medium,  defined  as  the  aerospace.  Recall  that 
General  Thomas  White  first  defined  the  aerospace  in  1958  and 
said  that  "air  and  space  comprise  a  s*  .gle  continuous  opera¬ 
tion  field  in  which  the  Air  Force  must  continue  to  function" 
C6:2-13.  Our  thrust  is  that  environmental  doctrine  must 
consider  space  as  part  of  the  operational  environment,  and 


not  as  a  specific  mission.  Others  may  argue,  and  justifia¬ 
bly  so,  that  space  is  a  unique  environment,  just  as 
different  from  the  endoatmosphere  as  the  ocean  environment 
is  from  the  air.  From  this  perspective,  one  could  easily 
contend  that  space  doctrine  should  not  be  linked  in  any  way 
to  Air  Force  doctrine,  which  emphasizes  military  air 
operations. 

A  second  limitation  is  that  we  were  unable  to  clearly 
discriminate  between  various  elements  at  some  of  the  levels 
in  our  hierarchy.  As  we  will  show,  in  some  cases  it  is 
difficult  to  discriminate  between  tasks  and  missions,  tasks 
and  requirements,  or  even  requirements  and  missions.  The 
MSSTP  hierarchy  had  the  same  problem.  We  believe  this  is  an 
inherent  limitation  with  modeling  the  military  environment 
from  a  mission  needs  perspective.  In  some  cases,  what  are 
described  as  tasks  may  be  primary  missions  to  support  mili¬ 
tary  goals.  The  specific  delineations  between  these 
elements  are  dynamic  and  depend  on  the  scope  and  nature  of 
the  problem  under  consideration.  Thus,  we  feel  the  hierar¬ 
chy  is  useful  as  a  general  framework,  but  that  users  may 
have  to  tailor  it  somewhat  to  fit  their  particular  needs. 
We  will  point  out  some  examples  of  this  somewhat  paradoxical 
situation  when  we  discuss  missions,  tasks,  and  requirements. 

Finally,  we  note  that  after  we  developed  our  hierarchy 
the  Air  Force  revised  AFM  1—1,  "Functions  and  Basic  Doctrine 
of  the  United  States  Air  Force"  E73.  It  corrects  many  of 
the  problems  we  noted  with  the  old  AFM  1-1  C63  and  is  more 


representative  of  basic  or  fundamental  doctrine.  A  major 
change  is  that  the  new  doctrine  dropped  Space  Operations  as 
an  Air  Force  mission.  Me  do  the  same  in  our  hierarchy. 
Mhere  applicable,  we  have  referenced  both  the  new  and  old 
Air  Force  published  doctrine  in  the  discussion  that  follows. 

The  Hierarchy 

The  hierarchy  we  propose  is  shown  in  Figure  G-2.  Me 
also  show  the  connectivity  between  technology  issues  and  the 
scientific-technological  instrument  of  national  power  for 
completeness.  Me  already  discussed  the  higher  levels  of  the 
hierarchy  (national  interests,  national  objectives,  national 
policies  and  instruments  of  national  power)  in  some  detail 
in  Chapter  Five.  Our  interest  here  is  in  describing  the 
levels  of  the  mission  needs  hierarchy  in  greater  detail. 
This  hierarchy  is  shown  under  the  military  instrument. 

The  Military  Instrument.  The  military  is  one  of 
the  instruments  of  national  power.  The  national  leadership 
determines  when  and  how  the  military  instrument  is  to  be 
applied  in  support  of  national  objectives  and  policy.  Since 
our  interest  is  with  the  Air  Force,  we  deal  only  with  this 
Service  in  our  hierarchy.  However,  we  have  incorporated  DoD 
space-rel ated  areas  in  the  hierarchy  to  ensure  we  represent 
all  military  requirements  in  the  space  medium. 

Fundamental  Military  Objective.  The  old  AFM  1—1 
listed  four  fundamental  military  objectives:  sustain  deter¬ 
rence,  assure  territorial  integrity,  conduct  warfare,  and 
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National  Interests 

I 

National  Security  Objectives 
National  Policies 

I 

Instruments  of  National  Policy 

Military  Instrument— — Science/Technology  Instrument 
(Air  Ijorce) 

Fundamental  Military  Objective 
Air  Force  Resjionsibi  1  i ti es 
Aerospace  Missions 

I 

Mission  Tasks 

I 

Task  Requirements 

1  <— . —  Performance  Measures 


Technology  Issue: 


Technology  Issues 


Selection  Criteria 


Figure  G-2.  Space  R&D  Advocacy  Hierarchy 


resolve  conflict  quickly  and  on  terms  favorable  to  the 
United  States.  The  new  AFM  1—1  changed  these  somewhat, 
reducing  the  list  to  three.  These  are  C7:l-23: 

1.  Deter  attacks  against  the  United  States, 
our  allies,  and  against  vital  US  interests  world¬ 
wide,  including  sources  of  essential  materials, 
energy,  and  associated  lines  of  communication. 

2.  Prevent  an  enemy  from  politically  co¬ 
ercing  the  United  States,  its  allies,  and  friends. 

3.  If  deterrence  fails,  fight  at  the  level 
of  intensity  and  duration  necessary  to  attain  US 
political  objectives. 

For  the  sake  of  clarity,  we  reduced  these  elements  to 
one  fundamental  military  objective:  Resolve  conflict 
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quickly  and  on  terms  -favorable  to  the  United  States.  Sus¬ 
tain  deterrence  and  assure  territorial  integrity  are  more 
appropriately  defined  as  national  security  objectives  or 
interests.  Inherent  in  deterrence  and  preventing  coercion 
is  having  the  necessary  force  structure  to  resolve  conflict. 
If  you  do  not  have  a  strong  enough  force  structure,  then  you 
cannot  be  expected  to  deter  a  potential  adversary  from 
taking  aggressive  or  coercive  action  against  you.  Con¬ 
ducting  warfare  is  implied  in  our  definition  of  the 
fundamental  military  objective. 

flir  Force  Responsibilities.  These  are  major 
functions  assigned  to  the  Air  Force  by  law  and  DoD  direc¬ 
tives.  AFM  1-1  C63  lists  several  sources  from  which  these 
major  responsibilities  are  derived.  They  include:  the  Na¬ 
tional  Security  Act  of  1947;  the  National  Aeronautics  and 
Space  Act  of  1958,  which  identifies  the  Air  Force  as  the  DoD 
Executive  Agent  for  space;  JCS  Pub  2,  "JCS  Unified  Action; " 
and  DoD  Directive  5100.1,  "Functions  Paper"  of  1958.  The 
major  role  of  the  Air  Force  is  to  conduct  aerospace  opera¬ 
tions  in  support  of  the  national  interest  of  the  United 
States.  AFM  1-1  [63  lists  eight  primary  and  three  collater¬ 
al  functions  C6: 2-1, 2-23: 

1.  Conduct  prompt  and  sustained  combat  opera¬ 
tions  in  the  air  to  defeat  enemy  airpower; 

2.  Formulate  doctrine  and  procedures  for  the 
organizing,  equipping,  training,  and  employment  of 
Air  Force  forces; 


3.  Provide  forces  for  strategic  air  warfare; 


4.  Provide  air  transport  -for  worldwide  de¬ 
ployment; 

5.  Provide  adequate,  timely,  and  reliable 
intel 1 igencej 

6.  Furnish  close  combat  and  logistical  air 
support  to  the  Army,  to  include:  airlift,  support, 
and  resupply  of  airborne  operations;  tactical 
reconnaissance  and  aerial  photography;  and  inter¬ 
diction  of  enemy  lines  of  communication; 

7.  Provide  aerial  photography  for  cartograph¬ 
ic  purposes; 

8.  Coordinate  with  and  support  other  Services 
in  developing:  doctrines  and  procedures  for  the 
unified  defense  of  the  US;  doctrines,  procedures, 
and  equipment  for  air  defense  of  land  areas;  tac¬ 
tics,  techniques,  and  equipment  for  amphibious 
operations;  doctrines,  procedures,  and  equipment 
for  airborne  operations; 

9.  (Three  collateral  functions)  Train  forces 
to:  interdict  enemy  sea  power;  conduct  antisubma¬ 
rine  warfare  and  to  protect  friendly  shipping;  and 
conduct  aerial  mine-laying  operations. 

We  reduce  thi.  list  to  seven  major  responsibilities. 
The  major  changes  were  to  incorporate  like  areas  into  the 
same  function  (i.e.  all  references  to  photography  are  listed 
under  a  single  responsibility)  and  to  incorporate  environ¬ 
mental  doctrine  in  our  definitions.  A  weakness  with  listing 
these  functions  is  that  many  do  not  appear  to  be  on  the  same 
level  (some  appear  to  be  more  likely  candidates  for  specific 
tasks  than  broad  Service  responsibilities).  However,  our 
primary  intent  is  to  show  how  a  mission  needs  hierarchy 
could  be  developed  taking  environmental  doctrine  into  con¬ 
sideration.  Since  we  are  not  specifically  defending  the 
elements  comprising  each  level,  we  show  our  representative 
list  of  major  responsibilities  below.  These  are: 


1. 


combat  operations  in  the  aerospace  to  de-feat  enemy  air  and 
space  power.  In  order  to  maintain  -freedom  o-f  action 
throughout  the  aerospace  medium,  we  must  have  f orces 'capable 
o-f  securing  and  maintaining  control  o-f  this  critical  opera¬ 
tional  environment-  We  must  be  capable  o-f  denying  the  same 
•freedom  o-f  action  to  any  potential  enemy.  While  current 
treaty  obligations  and  international  law  preclude  the  em¬ 
ployment  o-f  offensive  weapons  o-f  mass  destruction  in  space, 
our  doctrine  and  -future  strategy  options  must  incorporate 
the  exoatmospheric  regions  of  this  operational  medium  in 
planning  and  force  employment  tactics.  Only  in  this  fashion 
can  we  be  prepared  to  conduct  warfare  throughout  all  possi¬ 
ble  warfighting  environments.  To  not  do  so  concedes  the 
space  arena  to  the  enemy. 

2.  Provide  forces  for  strategic  aerospace  warfare. 
Our  highest  defense  priority  is  to  deter  strategic  nuclear 
attack  on  the  United  States  or  its  allies.  A  key  element  to 
successful  deterrence  is  possessing  and  demonstrating  the 
capability  to  fight  and  exact  such  damage  on  an  enemy  to 
dissuade  him  from  initiating  a  strategic  nuclear  attack. 
Currently  the  nuclear  triad  forces  provide  this  capability. 
While  international  law  and  treaty  obligations  prohibit  us 
from  deploying  weapons  of  mass  destruction  in  space,  our 
doctrine  and  future  strategies  must  consider  and  plan  for 
this  contingency.  An  integral  aspect  of  strategic  warfare 
is  adequate  warning  of  attack  to  provide  the  capability  to 


launch  counterattacks,  survive  attack. 


and  reconstitute 


forces.  Space-based  systems  signif icantly  contribute  to 
this  warning  capability. 

3.  Provide  adequate.  timely.  and  reliable  intelli¬ 
gence. _ surveillance. _ reconnaissance.  and  aerospace 

photography.  This  function  consolidates  three  functions 
listed  in  AFM  1-1:  tactical  reconnaissance  and  aerial 
photography;  provide  adequate,  timely,  and  reliable  intelli¬ 
gence;  and  provide  aerial  photography  for  cartographic 
purposes.  It  also  recognizes  our  capability  for  performing 
these  functions  from  exoatmospheric  platforms  by  redesig¬ 
nating  the  operational  environment  from  aerial  to  aerospace. 
The  functions  of  intelligence,  survei 1 lance,  and  reconnais¬ 
sance  support  to  some  degree  all  other  functions  and  Air 
Force  missions.  Without  accurate  intelligence,  reliable 
surveillance  and  responsive  reconnaissance,  our  forces  can¬ 
not  be  expected  to  sustain  deterrence  or  resolve  conflict. 

4.  Provide  the  capability  to  interdict  enemy  targets. 
This  function  consolidates  the  following  functions  listed  in 
AFM  1—1:  interdict  enemy  lines  of  communication  and  the 
collateral  functions  of  interdiction  of  enemy  sea  power  and 
conduct  mine-laying  operations.  To  resolve  conflict  on 
terms  favorable  to  the  United  States  we  must  be  capable  of 
conducting  warfare  across  the  entire  conflict  spectrum.  To 
support  this  objective,  we  must  be  capable  of  destroying  or 
inflicting  damage  on  enemy  targets  in  all  mediums  (land, 
sea,  and  aerospace)  and  disrupt  enemy  lines  of  communica— 
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tion.  We  must  foresee  the  possibility  of  extending 
interdiction  capability  to  the  exoatmospheri c  regions  to 


negate  or  destroy  enemy  capabilities  in  this  environment. 

5.  Provide  forces  for  aerospace  defense  of  US  and 
allied  territories  and  resources.  This  function  incorpo¬ 
rates  the  space  responsibilities  of  conducting  needed 
defensive  operations  to  protect  our  use  of  space  and  con¬ 
ducting  space  operations  to  protect  US  resources  from 
threats  in  and  from  space  {listed  in  AFM  1-6  E8J)  with  the 
AFM  1-1  function  of  equip  for  air  defense  of  land  areas. 
This  defense  function  directly  supports  the  national  objec¬ 
tives  of  assuring  territorial  integrity  and  sustaining 
deterrence  by  contributing  to  our  capability  to  resolve 
conflict.  We  must  be  prepared  to  defend  critical  assets  and 
territory  in  all  operational  media,  including  space.  Many 
of  our  indications  and  warning  systems,  surveillance  and 
reconnaissance  platforms,  and  crucial  communications  systems 
are  space— based  and  protection  of  these  assets  is  tantamount 
to  successfully  deterring  and  countering  enemy  attack.  Our 
environmental  doctrine  must  consider  innovative  tactics  and 
strategies  for  protecting  these  space-based  assets,  as  well 
as  consider  the  potential  for  protecting  key  land  areas  from 
space— based  defensive  weapons  platforms. 

6.  Formulate  doctrine  and  procedures  for  the  organ¬ 
izing.  enuiooino.  training  and  employment  of  Air  Force 
forces.  This  major  responsibility  is  basically  unchanged 
from  that  listed  in  AFM  1-1. 
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Coordinate  with  and  support  other  Services  in  -joint 


operations  and  strategy.  This,  too,  is  basically  unchanged 
■from  AFM  1-1. 

Aerospace  Missions.  AFM  1-1  lists  nine  primary 
missions,  one  collateral  mission,  and  various  -functions 
(specialised  tasks)  that  the  Air  Force  performs  in  support 
of  its  primary  responsibilities.  The  primary  missions  are: 
strategic  aerospace  offense;  space  operations;  strategic 
aerospace  defense;  airlift;  close  air  support;  air  interdic¬ 
tion;  counterair  operations;  surveillance  and  reconnais¬ 
sance;  and  special  operations.  The  collateral  mission  is 
described  as  operations  against  enemy  naval  operations  while 
the  other  functions  are  intelligence,  command  and  control , 
communications,  indications  and  warning,  data  processing, 
environmental  monitoring,  and  aerial  refueling.  Most  of  the 
missions  listed  have  sub-elements  that  further  describe  or 
specify  the  missions. 

A  key  concern  we  had  with  the  list  is  that  space  opera¬ 
tions  is  broken— out  separately  from  other  Air  Force 
missions,  despite  the  fact  that  AFM  1-1  acknowledges  that 
space  is  an  environment  in  which  the  Air  Force  must  operate. 
There  is  one  notable  exception.  Space  defense  is  listed  in 
conjunction  with  strategic  aerospace  defense.  Under  the 
space  operations  mission  are  listed  two  types  of  operations: 
space  support  and  force  enhancement.  We  disagree  with  des¬ 
ignating  force  enhancement  as  a  mission  support  element. 


Any  system  or  capability  deployed  is  essentially  an 


"enhancement"  over  previous  systems  or  capabilities,  irre¬ 
spective  of  the  environment  the  system  is  designed  to 
operate  in. 

We  believe  that  another  mission  ordering  is  appropriate 
and  better  represents  space  as  an  integral  part  o-f  the 
operating  environment  o-f  the  US  Air  Force.  By  consolidating 
aspects  of  certain  missions,  renaming  several,  and  deleting 
a  few,  we  came  up  with  the  following  list  of  eight  missions: 
strategic  aerospace  offense;  strategic  aerospace  defense; 
aerospace  lift  support;  close  aerospace  support;  aerospace 
interdiction;  counteraerospace  operations;  special  opera¬ 
tions;  and  surveillance  and  reconnai ssance.  The  following 
points  describe  each  of  these  suggested  missions  and 
identify  changes  made  to  the  structure  currently  in  AFM  1-1. 
Note  that  all  ncorporate,  or  could  incorporate  operations 
in  space. 

1.  Strategic  Aerospace  Offense.  This  mission  is 
retained  with  no  changes  over  what  is  listed  in  AFM  1—1. 
Strategic  aersopace  forces  act  as  a  deterrent  to  nuclear 
war.  They  represent  the  capability  to  inflict  such  damage 
on  a  potential  nuclear  enemy  so  as  to  make  the  idea  of 
nuclear  warfare  unacceptable  for  any  side  to  initiate.  To 
be  a  credible  deterrent,  these  forces  must  be  capable  of 
surviving  attack,  reconsti tuting  forces,  and  preserving  a 
sufficient  attack  capability  so  as  to  inflict  devastating 
losses  on  an  attacking  enemy.  Strategic  offensive  forces 
must  be  capable  of  penetrating  enemy  defenses  and  delivering 
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nuclear  weapons  accurately  against  assigned  targets. 


In  addition  to  weapons  delivery  systems  and  penetration 
aids,  other  requirements  exist  that  are  essential  to  support 
this  mission.  Strategic  offensive  forces  must  have  suffi¬ 
cient  warning  to  disperse  and/or  launch  counterattacks  and 
survive  initial  attacks.  Command,  control,  and  communica¬ 
tions,  data  processing  and  navigation  aids  must  be 
responsive,  reliable  in  a  nuclear  environment,  secure, 
redundant  and/or  survivable.  While  international  law  cur¬ 
rently  prohibits  deploying  weapons  of  mass  destruction  in 
space,  it  is  technol ogi cal 1 y  feasible  to  do  so  and  would 
provide  an  alternative  to  add  to  the  existing  triad  that 
would  present  unique  and  perplexing  challenges  to  a  poten¬ 
tial  enemy’s  defensive  forces. 

Certain  "force  enhancement"  capabilities  listed  in  AFM 
1-1  under  space  operations  potentially  apply  to  strategic 
aerospace  offense.  They  include:  conduct  global  surveil¬ 
lance,  worldwide  command  and  control  support,  provide 
precise  positioning  and  navigation  data,  and  present  timely 
and  detailed  meteorol  ogi  cal  information. 

2.  Strategic  Aerospace  Defense.  This  mission  is 
unchanged  from  that  listed  in  AFM  1—1.  AFM  1-1  already 
incorporated  space  defense  as  an  integral  element  of  the 
total  strategic  aerospace  defense  mission.  This  mission 
enhances  deterrence  by  denying  and/or  nullifying  hostile 
acts  in  or  through  the  aerospace.  To  protect  national 


sovereignty  during  peacetime,  crises  and  war,  strategic 
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identify, 


aerospace  defense  must  detect,  identify,  intercept  and  de¬ 
stroy  hostile  vehicles  attempting  to  penetrate  our  aerospace 
and  do  this  mission  under  all  meteorol ogi cal  conditions.  It 
must  provide  adequate  warning  and  assessment  of  strategic 
attack  and  tactical  warning  to  the  national  command  authori¬ 
ties.  Defense  farces  must  be  capable  of  protecting  the 
territory  of  the  US  and  its  allies,  as  well  as  critical 
resources  on  the  land,  sea,  or  in  the  aerospace.  War¬ 
fighting  defensive  systems  must  be  flexible  and  highly 
responsive  to  be  capable  of  neutralizing  threats.  We  have 
incorporated  the  following  collateral  missions  listed  in  AFM 
1-1  under  operations  against  enemy  naval  forces:  defend 
friendly  naval  forces  and  engage  in  anti-submarine  warfare. 
The  task  of  delivering  mines  supports  this  mission. 

Exoatmospheri c  systems  offer  tremendous  potential  for 
future  aerospace  defense  capabilities.  For  example,  the 
capability  to  detect  and  destroy  nuclear  warheads  before 
they  reenter  the  atmosphere  is  one  particular  mission 
addressed  by  the  SDI  concepts. 

Critical  to  the  successful  accomplishment  of  this  mis¬ 
sion  is  a  capability  to  detect,  track  and  identify  all 
objects  in  the  aerospace.  To  be  fully  effective,  strategic 
aerospace  forces  must  be  able  to  discriminate  between  actual 
targets  and  possible  decoys  or  background  "clutter."  Effec¬ 
tive  command  and  control  is  absolutely  essential.  Battle 
management  systems  must  be  capable  of  acquiring  targets, 
destroying  or  negating  them,  and  confirming  target  destruc- 


tion  or  misses  in  time  to  attack  the  target  again  or  pass 
responsi bi  1  i ty  for  its  destruction  to  another  defensive 
element. 

The  following  "force  enhancements"  may  have  applica¬ 
bility:  conduct  global  survei 1 1 ance,  enable  worldwide 
command  and  control,  provide  precise  positioning  and  naviga¬ 
tion  data,  and  present  timely  and  detailed  meteorological 
information.  From  space  support  (we  show  this  under  Aero¬ 
space  Lift  Support)  satellite  surveillance  and  control  is 
likely  to  be  a  supporting  factor,  as  would  on-orbit  support 
for  space— based  defensive  systems. 

3.  Aerospace  Lift  Support.  This  mission  was  original¬ 
ly  designated  “airlift"  in  AFM  1-1.  It  included  both 
strategic  and  tactical  airlift,  providing  a  capability  to 
deploy  forces  to  any  part  of  the  world  and  support  them 
there.  Airlift  embodies  a  key  facet  of  a  fundamental  Air 
Force  capability  —  rapid,  long  range  mobility.  Comprised 
of  both  military  and  civil  contract  aircraft,  the  airlift 
mission  directly  supports  or  provides:  employment  opera¬ 
tions,  strategic  and  tactical  deployment  of  combat  forces 
and  equipment,  logistics  support,  and  aeromedical  evacua¬ 
tion.  We  have  changed  the  name  of  this  mission  to  reflect 
supporting  the  same  or  similar  capabilities  in  space.  We 
have  consolidated  space  support,  listed  in  AFM  1-1  as  one  of 
three  distinct  space  responsibilities,  with  airlift  to  form 
the  Aerospace  Lift  Support  mission.  In  addition  to  tradi¬ 
tional  (endoatmcspheric)  roles,  aerospace  lift  support  must 


provide  launch  and  recovery  support  -for  space  payloads,  on- 
orbit  support  of  space  platforms,  and  satellite  surveillance 
and  control .  As  we  expand  into  space,  our  scope  of  responsi¬ 
bility  to  support  space-based  systems  will  also  expand. 
Resupplying  manned  platforms,  evacuating  injured  or  ill 
space  personnel,  providing  orbital  maintenance  and  replace¬ 
ment,  and  controlling  space  platforms  are  a  few  of  the  many 
tasks  which  may  have  to  be  accomplished  in  space. 

In  addition  to  improvements  necessary  to  support  our 
worldwide  deployment  of  forces  capability  (inter/intra  thea¬ 
ter  airlift  aircraft  capable  of  transporting  existing 
weaponry  and  forces)  we  must  be  able  to  launch  payloads  of 
varying  mass  into  space  into  a  variety  of  orbits  and  incli¬ 
nations.  This  could  entail  a  capability  for  transferring 
payloads  from  low  earth  orbit  to  geosynchronous,  con¬ 
structing  large  platforms  in  space,  staring  highly  corrosive 
and/or  dangerous  reactants  in  space,  supporting  a  manned 
presence  in  space,  and  many  other  potential  roles.  Naviga¬ 
tion  aids,  survivable  and  secure  communications,  and  command 
and  control  support  will  be  essential  to  support  this 
mi ssi on . 

4.  Close  Aerospace  Support.  Listed  in  AFM  1-1  as 
close  air  support,  we  have  changed  the  mission  description 
to  include  the  space  environment  as  well.  AFM  1-1  mentions 
that  close  air  support  involves  air  attacks  against  hostile 
targets  that  are  in  close  proximity  to  friendly  forces.  It 
may  be  used  to  support  offensive  or  defensive  operations  by 
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friendly  fares s.  Close  air  support  requires  access  to  the 
battle-field,  accurate  weapons  delivery,  and  target  coordina¬ 
tion  between  surface  and  air  forces.  Close  air  support 
enhances  surface  force  operations  by  providing  a  wide  range 
of  weapons  and  greater  mass  at  decisive  points;  flexibility, 
shock,  innovation,  and  surprise;  and  firepower,  maneuver, 
and  flank  protection.  We  have  also  incorporated  the  capa¬ 
bility  to  neutralize  or  destroy  enemy  naval  forces,  which  is 
listed  as  one  of  the  collateral  missions  in  AFM  1-1  under 
operations  against  enemy  naval  forces.  While  it  may  be 
difficult  to  imagine  any  near  term  close  "space"  support 
role  where  space  fighter  bombers  attack  enemy  space  forces, 
some  people  have  already  suggested  how  space-based  weapons 
could  be  used  to  support  surface  operations.  Again,  for 
reasons  mentioned  earlier,  we  should  not  close  the  door  on 
future  possibilities  in  supporting  this  mission  either  in 
space  or  with  space-based  systems. 

The  most  likely  applications  for  space  support  of  this 
mission  would  appear  to  be  space-based  weapons  providing  pin 
point  delivery  on  enemy  positions  in  supporting  friendly 
surface  or  naval  forces  (space-based  defense  of  space  sys¬ 
tems  falls  under  another  mission  category).  To  accomplish 
this  mission  would  require  precise  navigational,  command, 
control ,  and  communications,  and  data  processing  systems; 
extremely  accurate  pointing  and  tracking  capabilities;  a 
complete  understanding  of  atmospheric  interactions  with 
whatever  weapon  kill  mechanism  is  used;  and  many  others. 


Frankly,  in  the  foreseeable  future,  the  major  role  for 
space  in  supporting  this  mission  will  probably  be  providing 
ground  and  air  forces  with  precise  navigational  information, 
reliable  and  responsive  communications/data  links,  and 
meteorological  data  from  space-based  platforms.  Costs  and 
critical  operational  concerns  would  seem  to  dictate  that 
this  mission  can  be  more  effectively  conducted  with  endoat- 
mospheric  systems  at  the  present  time. 

5.  Aerospace  Interdi cti on .  This  mission  was  defined 
as  "air  interdiction"  in  AFM  1-1  and  related  to  operations 
conducted  against  an  enemy’s  potential  before  it  could  be 
effectively  used  against  friendly  surface  forces.  Its  goal 
is  to  prevent  enemy  forces  from  sustaining  an  effective 
level  of  combat  and  to  deny  them  their  military  objectives. 
In  this  respect,  aerospace  interdiction  would  extend  these 
same  responsibilities  for  interdicting  enemy  capabilities  in 
space  before  they  can  be  used  against  friendly  space  or 
earth-based  farces  and  resources.  Aerospace  interdiction 
requires  a  capability  to  attack  fixed,  moving,  and  movable 
point  and  area  targets.  Targets  would  include  enemy  lines 
of  communication;  enemy  supplies;  and  unengaged  enemy  forces 
in  rear  areas.  Interdiction  missions  could  also  include 
attacks  against  an  enemy’s  uncommitted  naval  forces.  For 
this  reason  we  have  also  included  the  capabilities  to  neu¬ 
tralize  or  destroy  enemy  naval  forces,  engage  in  anti¬ 
submarine  warfare,  and  deliver  mines,  which  were  listed  in 
AFM  1-1  under  the  collateral  mission  operations  against 


enemy  naval  forces. 


To  effectively  interdict  enemy  targets,  friendly  forces 
must  know  the  target  location,  environmental  conditions,  and 
enemy  defenses;  be  able  to  counter  enemy  defenses;  and 
acquire,  track,  and  destroy  targets.  These  requirements 
identify  the  need  for  accurate  intelligence,  surveillance, 
reconnaissance,  command  and  control,  pointing  and  tracking 
accuracy,  electronic  countermeasures  and  counter -counter 
measures,  and  weapons  systems  (delivery  platform  and  kill 
mechanisms)  capable  of  destroying  designated  targets. 

Extending  interdiction  capabilities  in  space  is  logi- 
cal.  As  potential  enemies  become  more  dependent  on  space 
systems  to  support  their  warfighting  capabilities,  these 
systems  become  more  lucrative  targets.  Since  we  must  be 
prepared  to  fight  at  any  level  in  the  conflict  spectrum,  we 
need  to  consider  requirements  for  an  interdiction  capability 

in  space.  Additionally,  many  of  the  technologies  required  i 

( 

to  support  air— to— ground  missions  (weapons  acquisition  and 
tracking  sensors,  guidance  systems,  etc)  also  support  space 
requirements.  Space— based  systems  obviously  could  play  an 
important  support  role  by  providing  the  navigation,  communi¬ 
cations,  intelligence,  and  reconnaissance  support  required 
for  aircraft  to  effectively  carry  out  an  ai r-to-ground 
interdiction  mission. 

6.  Counter aerospace  Operations.  This  mission  is 
defined  in  AFM  1-1  as  "counterair  operations."  We  extended 
the  operational  environment  to  include  space. 
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Given  that 


the  ultimate  goal  o-f  counterair  operations  is  to  gain  and 
maintain  air  superiority,  counter aerospace  operations  would 
be  conducted  to  gain  and  maintain  superiority  in  the  space 
region  as  well.  Aerospace  supremacy  is  a  condition  that 
gives  friendly  forces  freedom  of  action  throughout  the  area 
of  conflict  and  at  the  same  time  denies  the  enemy  the  same 
freedom.  This  is  accomplished  by  destroying  or  neutralizing 
the  enemy’s  offensive  and  defensive  aerospace  capabilities. 

Counterair  operations  were  broken  out  in  three  distinct 
areas:  offensive  and  defensive  counterair  and  defense  sup¬ 
pression.  The  same  areas  apply  to  aerospace  applications. 

Offensive  counteraerospace  systems  must  be  designed  to 
seek  out  and  destroy  the  enemy’s  offensive  counter aerospace 
systems  and  support  facilities  in  order  to  gain  supremacy  in 
the  aerospace  medium. 

Defensive  counter aerospace  operations  are  tasked  to 
deny  the  enemy  the  freedom  to  carry  out  offensive  opera¬ 
tions,  and  to  defend  supply  lines,  protect  friendly  bases, 
and  support  land  and  naval  forces.  To  fulfill  these  roles 
counteraerospace  forces  must  be  capable  of  detecting,  iden¬ 
tifying,  intercepting,  and  destroying  enemy  aerospace 
forces. 

Defense  suppression  is  designed  to  degrade,  neutralize, 
or  destroy  the  enemy’s  aerospace  defense  and  command  and 
control  systems.  In  this  regard,  defense  suppression  di¬ 
rectly  supports  offensive  and  defensive  counteraerospace 
operations  by  inhibiting  (using  lethal  or  nonlethal  meas- 
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ures)  enemy  capabilities  -for  defensive  actions.  Electronic 
warfare,  electronic  counter  measures,  and  electronic 
counter-counter  measures  are  frequently  the  mechanisms  for 
accompl i shi ng  this  mission. 

To  accomplish  counteraerospace  missions,  we  must  not 
only  have  capable  weapons  platforms  and  systems,  but  acqui¬ 
sition  and  tracking,  electronics,  communications,  precise 
positioning,  environmental  monitoring,  data  processing,  and 
intelligence  capabilities  as  well. 

Maintaining  freedom  of  action  in  space  is  a  national 
security  objective,  so  it  is  not  difficult  to  justify  incor¬ 
porating  the  space  environment  in  this  traditional  Air  Force 
role.  The  need  to  possess  supremacy  in  space  is  obvious  — 
we  rely  so  much  (totally  in  some  cases)  on  space-based 
systems  to  provide  attack  warning,  intelligence,  and  commu¬ 
nications  that  we  cannot  afford  to  put  them  at  risk  to  enemy 
space-based  attack. 

7.  Special  Operations.  Special  operations  forces 
support  the  unified  commanders  at  the  direction  of  the  NCA. 
These  operations  are  carried  out  by  specially  trained  and 
equipped  farces  from  each  Service  as  a  team  in  support  of  US 
security  objectives.  Special  operations,  which  are  under¬ 
taken  in  enemy  controlled  or  politically  sensitive 
territory,  cover  a  broad  spectrum  of  actions  and  are  con¬ 
ducted  at  every  level  of  conflict.  Unconvent i onal  warfare, 
foreign  internal  defense,  and  psychological  warfare  are 
examples. 
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To  accomplish  the  variety  o-F  tasks  required  by  this 
mission  description,  forces  must  have  secure  and  responsive 
communications,  command  and  control,  reconnai ssance  and 
intelligence.  Space  systems  provide  many  of  these  capabili¬ 
ties.  While  it  may  be  difficult  to  conjecture  conducting 
special  operations  in  the  space  environment  anytime  in  the 
near  future,  space-based  platforms  will  certainly  continue 
to  support  these  types  of  missions. 

8.  Surveillance  and  Reconnaissance.  Although  AFM  1-1 
lists  surveillance  and  reconnai ssance  as  a  mission,  both  can 
be  defined  as  “functions"  as  well.  We  use  manned  and 
unmanned  aerospace  vehicles,  as  well  as  land-based  sensors, 
to  carry  out  strategic  and  tactical  surveillance  and  recon¬ 
naissance.  These  operations  provide  early  warning  of  enemy 
actions  and  other  information  vital  to  the  NCA  and  field 
commanders.  They  help  identify  enemy  capabilities  and  force 
structure.  Surveillance  systems  collect  information  contin¬ 
uously  from  the  aerospace  and  from  the  earth’s  surface  and 
subsurface.  They  provide  information  on  enemy  attacks, 
including  their  source,  nature,  and  size.  They  predict  the 
impact  point  of  missile  warheads.  They  tell  us  the  location 
and  timing  of  nuclear  detonations  and  other  attack 
assessment  data. 

Reconnai ssance  missions  are  directed  towards  localized 
cr  specific  targets.  Through  these  missions  a  variety  of 
data  are  collected,  including  metecrol ogi cal ,  hydrographi c , 
geographic,  electronic,  and  communications  characteristics 
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on  any  given  area  of  the  earth’s  surface.  Together,  sur¬ 
veillance  and  reconnaissance  provide  information  on  the 
activities  and  resources  of  any  potential  enemy. 

Surveillance  and  reconnaissance  support  both  strategic 
and  tactical  arenas.  Strategic  surveillance  and  reconnais¬ 
sance  support  our  needs  for  national  and  strategic 
intelligence,  allowing  us  to  assess  the  total  capability  of 
a  foreign  nation  to  wage  war  and  monitor  the  progress  of  a 
war.  Tactical  operations  support  the  theater  and  the  tacti¬ 
cal  field  commanders.  They  provide  indications  of  hostile 
intent,  plus  information  from  which  intelligence  is  derived. 
We  have  also  incorporated  the  collateral  mission  of  pro¬ 
viding  surveillance  and  reconnai ssance  support  in  operations 
against  enemy  naval  forces  under  this  mission. 

Strategic  surveillance  and  reconnaissance  systems  must 
allow  us  to:  identify  targets  for  strategic  and  tactical 
attack;  provide  indications  and  warning  of  hostile  intent 
and  actions?  assess  damage  to  enemy  and  friendly  targets; 
determine  force  structure;  determine  our  requirements  for 
R&D  of  warfighting  systems;  and  help  verify  compliance  with 
treaties  and  agreements.  Additionally,  they  provide  infor¬ 
mation  that  assists  the  military  authorities  in  analyzing 
and  developing  tactics  to  counter  enemy  deployment  and 
employment.  Tactical  systems  provide  information  on:  the 
disposition,  composition,  and  movement  of  enemy  forces;  the 
location  of  enemy  lines  of  communication,  installations,  and 
electronic  emissions;  post-strike  damage;  conditions  in 
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surface  battle  areas;  and  weather  and  terrain. 

Space-based  systems  have  been  invaluable  in  supporting 
surveillance  and  reconnai ssance  missions.  Not  only  are 
space— based  systems  more  capable  than  many  other  systems  (in 
some  cases  they  are  the  only  systems  that  can  provide  re¬ 
quired  capabilities),  they  often  are  more  economical.  We 
depend  heavily  on  these  systems  to  provide  indications  and 
warning  of  attack  and  communications  with  our  strategic 
forces.  These  assets  are  vulnerable  to  various  enemy 
countermeasures ,  including  ground-based  laser  blinding, 
jamming,  and  even  destruction  by  enemy  anti -satel 1 i te 
systems. 

This  concludes  our  discussion  of  aerospace  missions. 
We  have  shown  how  redefining  missions  to  include  space  as 
part  of  the  operational  environment  s^cill  gives  full  cover¬ 
age  t  all  mission  areas.  It  also  allows  R2<D  and  mission 
planners  to  be  broader  scoped  in  considering  future  military 
raqui rements .  In  the  next  section  we  discuss  military  tasks 
that  can  be  performed  or  supported  by  space-based  system. 
These  tasks  directly  link  to  the  missions  we  have  j—.'4- 
di scussed. 

Tasks.  Tasks  are  defined  as  those  specific  capabili¬ 
ties  required  to  accomplish  mission.  We  used  the  task  list 
developed  in  the  MSSTP  u/  a  point  of  departure  for  our  task 
list.  In  m-.'4-  cases  we  differ  very  little  in  substance  from 
the  tab!,-  defined  in  the  MSSTP.  We  have  separated  tasks 
into  eight  general  groupings. 
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1.  Reconstitution  of  Forces.  This  is  a  -fairly 
specific  task  supporting  primarily  the  strategic  aerospace 
offense  mission.  It  addresses  the  requirement  for 
regrouping  and  tasking  strategic  offensive  forces  after  an 
initial  attack.  This  task  places  considerable  demands  on 
communications  and  data  processing  functions,  among  others. 

2.  Launch  and  Recover  Space  Platforms  and  Payloads. 
This  obvious  task  is  necessary  to  deploy  any  space— based 
system.  The  requirements  of  the  system  (mass,  volume, 
orbit,  etc)  will  determine  the  specific  performance  level 
required  of  this  task. 

3 .  Detect,  track,  identify,  intercept,  and  destroy 
targets .  This  general  task  could  easily  be  further  broken 
down  into  separate  task  categories.  Since  this  is  a  rather 
obvious  option,  we  show  it  as  a  single  task  to  indicate  that 
sometimes  these  individual  tasks  may  overlap  or  be  combined 
into  a  synergistic  whole.  Normally  we  would  expect  this 
task  to  be  further  defined  by  the  type  of  target.  These 
include:  intercontinental  and  submarine  launched  ballistic 
missiles?  air  vehicles;  surface  targets  (land  and  sea 
based);  and  space  vehicles  and  platforms. 

This  task  category  replaces  such  MSSTP  tasks  as:  indi¬ 
cate  and  warn  of  attack  from  ballistic  mi ssi 1 es/SLBMs,  air 
vehicles,  space  vehicles  and  platforms;  discriminate  targets 
from  background  and  enemy  deception;  detect  nuclear  detona¬ 
tions  by  sice  and  location;  predict  impact  points  of 
ballistic  missiles;  and  perform  damage  assessment  following 
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tactical  or  strategic  attack. 

4.  Provide  on-crbit  support.  This  support  task  is 
essential  to  most  space-based  systems.  It  can  be  performed 
in  a  variety  of  ways  (ground-based  control ,  space— based 
maintenance,  etc).  We  also  include  refueling,  a  specialized 
task  listed  in  AFM  1—1,  in  this  category.  Future  space 
systems  may  depend  on  periodic  refueling  and  maintenance 
from  space  support  depots. 

5.  Penetrate  enemy  defenses.  This  task  depends  on  the 
vehicle  used  to  penetrate  defenses,  as  well  as  the  nature  of 
the  defense.  Types  of  vehicles  of  interest  to  space  plan¬ 
ners  are:  ballistic  mi ssi 1 es/SLBMs,  air  vehicles,  and  space- 
based  platforms  and  vehicles. 

6.  Environmental  Monitoring.  Environmental  informa¬ 
tion  is  an  essential  factor  in  planning  and  conducting  air 
and  surface  operations.  During  wartime,  weather  information 
becomes  an  integral  part  of  the  decision  process  in  employ¬ 
ing  forces,  selection  of  weapons  systems,  routes,  targets, 
and  delivery  tactics.  The  MSSTP  defined  environmental 
monitoring  as  a  function  (see  task  requirements,  it-low)  , 
However ,  we  believe  this  is  more  accurately  described  as  a 
task  that  directly  supports  a  variety  of  missions.  It  also 
requires  a.  variety  of  "functions"  to  support  it  depending  on 
the  specific  capabilities  called  for  in  the  task. 

7.  Electronic  Warfare.  Electronic  warfare  is  used  to 
counter,  deceive,  cr  destroy  the  enemy's  use  of  the  electro¬ 
magnetic  spectrum  during  offensive  or  defensive  operations. 


It  operates  in  three  dimensions:  electronic  war-fare  support 
measures,  electronic  counter  measures,  and  electronic 
counter-counter  measures.  Targets  are  usually  command  and 
control  systems,  radar  and  -fire  control  systems,  communica¬ 
tions  systems,  in-frared  and  electro-optical  systems,  and 
navigational  aids.  There  are  many  obvious  applications  -for 
electronic  warfare  in  space.  As  a  task  it  can  directly 
support  many  o-f  the  missions  discussed  earlier. 

8.  Command,  Control.  and  Communications.  We  break 
this  out  as  a  task  category,  although  the  MSSTP  does  not 
include  it  here.  Command,  control,  and  communication  sys¬ 
tems  provide  commanders  with  reliable,  rapid,  survivable, 
and  secure  communications  networks  to  command  and  control 
forces.  These  networks  depend  on  networks  of  intelligence, 
indications  and  warning,  communications,  data  processing, 
environmental  services,  and  trained  personnel.  They  allow 
the  commander  to  coordinate  the  planning,  direction,  and 
control  of  all  forces  and  operations.  They  also  provide 
commanders  the  status  and  capabilities  of  their  forces  as 
well  as  those  of  the  enemy.  They  can  direct  the  targeting  of 
weapons  and  the  tactical  advantage  inherent  in  shock  action 
and  maneuver.  Command,  control ,  and  communications  are 
essential  in  supporting  every  mission  category  discussed 
earl i er . 

Task  Requirements.  These  are  the  basic  building  blocks 
or  specific  capabilities  that  help  to  further  define  task 
performance  levels.  Tasks  may  require  one  or  more  of  these 


building  blocks. 


They  are  called  "•functions"  in  the  MSSTP, 


which  listed  15  (Appendix  C) .  Dur  list  is  much  less,  since 
we  described  space  operations  (launch  and  recovery  of 
payloads  and  platforms)  and  environmental  monitoring  as 
tasks.  The  five  general  categories  of  task  requirements  we 
define  are  discussed  below. 

1.  Commun i cat i ons .  Depending  on  task  and  mission 
requi rements,  communications  may  be  defined  by  several  of 
the  following  characteristics:  accuracy,  avai 1 abi 1 i ty, 
capacity,  flexibility,  i nteroperabi 1 i ty ,  timeliness,  jam- 
resistance,  mobility,  reliability,  security,  speed,  and 
survi vabi 1 i ty . 

2.  Data  Processing.  The  MSSTP  did  not  list  this  as  a 
function;  however,  we  believe  it  is  an  important  "building 
block"  to  support  numerous  tasks.  Characteristics  include: 
memory  size,  processing  speed,  hardening,  access,  software, 
timeliness,  and  capability  (type  and  number  of  specific 
functions  it  must  support  or  perf orm) . 

3.  Navi qati on .  This  task  requirement  can  be  charac¬ 
terized  by  positioning  accuracy  required  (in  three  or  less 
dimensions),  speed  of  vehicle  or  target,  direction,  heading 
accuracy,  and  timeliness. 

4.  Detect i on .  The  MSSTP  titled  this  surveillance  and 
broke  it  out  into  five  separate  "functions":  air  vehicle 
detection  and  track;  ballistic  missile  detection  and  track; 
nuclear  detonation,  detection,  and  location;  space  vehicle 
detection  and  track;  and  surface  target  survei 1 1 ance/recon- 


nai ssance. 


We  felt  these  were  mere  accurately  described  as 


tasks.  However,  we  do  agree  that  detection  should  be  listed 
as  a  task  requirement  since  it  will  determine  the  type  of 
sensors  employed  and  performance  required  of  the  sensor. 
Characteristics  include,  among  others:  field  of  view, 
resolution,  number  of  targets  capable  of  di scriminating, 
sensitivity,  power,  and  tracking  time. 

5.  Force  Aool ication.  This  most  necessary  task 
requirement  defines  the  types  of  weapon  systems  and  capa¬ 
bilities  required  to  support  many  of  the  tasks.  We  further 
categorize  force  application  according  to  the  target  to  be 
destroyed  or  neutralized:  air  vehicle  destruction,  ballis— 
tic/SLEM  missile  destruction,  space  vehicle  or  platform 
destruction,  and  surface  target  (land  and  sea)  destruction. 
Characteri sties  are  a  function  of  the  target,  employment 
tactics,  defenses,  weapons  platform,  and  the  physical  envi¬ 
ronment.  Specifics  include:  energy  required  on  target  for 
destruction,  range,  countermeasures,  timeliness,  kill  veri¬ 
fication,  and  power  requirements. 

Performance  Parameters.  While  not  actually  part  of  the 
hierarchy,  we  show  performance  parameters  as  an  integral 
factor  in  determining  performance  requirements  to  meet  mis¬ 
sions  and  tasks.  The  MSSTP  identified  si:-;  candidate 
parameters  to  be  used  to  further  define  specific  task  per¬ 
formance  requirements.  These  are  listed  below. 

Coverage:  Seographical  boundaries  over  which 

the  functions  must  be  performed. 
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Capacity:  The  number  a-f  units  served, 

detected,  identified,  tracked,  etc.  The  number 
of  messages,  units,  or  bits  transmitted  or 
received  per  second. 

Quality:  Quantitative  measures  of  the  dist¬ 

inguishing  attributes  such  as  location  accuracy, 
probability  of  detection,  false  alarm  rate,  proba¬ 
bility  of  correct  message  receipt,  track  accuracy, 
probability  of  kill,  etc. 

Timeliness:  Allowable  system  time  delays  or 

response  times  such  as  allowable  time  from  event 
detection  to  message  transmission  of  event 
detection . 

Availability:  Percentage  of  time  the  system 

must  be  in  position  and  able  to  accomplish  the 
assigned  task. 

Survivability:  Endurance  requirements  imposed 
by  the  military  mission  or  task.  Specified  in 
terms  of  duration  (minutes,  hours,  days,  years)  a 
function  must  be  available  to  accomplish  the 
associated  task. 

Technology  Issues.  The  final  level  of  our  hierarchy 
that  we  discuss  here  is  technology  issues.  The  performance 
attributes  discussed  above  allow  planners  to  determine 
specific  performance  needs  for  military  tasks.  If  existing 
technology  cannot  provide  required  performance  levels,  then 
a  technology  issue  is  defined.  If  planners  have  done  their 
job  well,  then  the  performance  deficiencies  become  the 
technology  issues.  Otherwise,  technology  issues  can  be 
identified  in  any  number  of  ways,  including:  system  con¬ 
cepts,  paper  studies,  experimentation,  laboratories, 
industry,  etc.  Regardless  of  how  technology  issues  are 
generated,  they  can  easily  be  linked  to  this  hierarchy  to 
determine  the  extent  of  their  contribution  to  satisfying 
mission  accompl ishment,  if  the  technology  issue  were  satis- 
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factorily  resolved. 


Limitations  Of  and  Uses  For  the  Hierarchy. 

We  note  here  that  discriminating  between  missions, 
tasks,  and  in  some  cases  task  requirements  ("-functions")  is 
dependent  entirely  upon  the  scope  and  nature  o-f  the  problem 
under  consideration.  Some  of  the  tasks  we  describe  could 
appear  to  be  missions.  As  we  mentioned  in  the  introduction, 
our  inability  to  define  a  set  of  collectively  exhaustive, 
mutually  exclusive  tasks  is  a  limitation  with  this  hierar¬ 
chical  structure.  However,  the  MSSTP  has  the  same  problems. 
As  we  pointed  out  in  Chapter  Five,  with  complex  real-world 
problems,  it  is  usually  impossible  to  completely  break  out 
hierarchical  levels  and  even  distinguish  between  elements. 

Nonetheless,  we  believe  this  model  is  still  useful  for 
long  range  mission  and  RS<D  planners  and  also  for  system 
designers.  It  can  be  used  as  a  structure  for  considering 
options,  defining  requirements,  and  specifying  performance 
deficiencies. 

Linkages  are  easily  derived  between  the  various  levels 
and  elements  within  each  level.  This  information  is  espe¬ 
cially  useful  for  mission  area  analyses,  where  weights  can 
be  assigned  to  the  various  elements  and  levels  based  on 
relative  importance  to  a  predefined  goal.  We  show  in  the 
fallowing  example  one  such  linkage  that  tracks  from  one  of 
the  Air  Force  responsibilities  through  missions,  tasks,  and 
task  requirements. 


Consider  the  responsibility  o-f  "provide  -forces  -for 
strategic  aerospace  warfare. “  Several  missions  support  this 
broad  responsibility,  including:  strategic  aerospace 

offense,  surveillance  and  reconnaissance,  aerospace  defense, 
aerospace  interdiction,  and  special  operations.  Analyzing 
one  of  these  missions  (strategic  aerospace  defense),  we  see 
that  a  number  of  tasks  can  be  linked  to  it.  In  this  case, 
we  select  the  following  tasks  as  applicable  to  strategic 
aerospace  defense:  launch  and  recover  space  platforms  and 

payloads;  provide  on-orbit  support;  detect,  identify,  track, 
and  destroy  ballistic  missiles,  air  vehicles,  and  space 
vehicles  and  platforms  (includes  also  prediction  of  impact 
points  of  ballistic  missiles,  discriminate  targets  from 
background  and  deception,  perform  damage  assessment,  and 
detect  nuclear  detonations);  electronic  warfare;  command, 
control ,  and  communications;  environmental  monitoring;  and 
penetrate  enemy  defenses  with  ant i -bal 1 i sti c  missiles,  air 
vehicles  (fighter  interceptors) ,  and  space-based  weapons. 
Analyzing  one  of  these  tasks  (command,  control,  and  communi¬ 
cations)  with  respect  to  task  requirements  helps  further 
define  the  specific  performance  required  of  the  task  to  meet 
mission  requirements.  This  task  must  be  supported  by  commu¬ 
nications,  data  processing,  detection,  and  possibly 
navigation.  Selecting  one  of  these  task  requirements  and 
evaluating  it  against  the  six  performance  parameters  will 
help  to  clearly  define  specific  performance  needs  required 
of  the  task  requirement  to  ultimately  meet  mission  require- 


Appendix  H:  Funding  Curves 


It  may  be  necessary  in  the  space  technology  advocacy 
problem  to  determine  the  budget  impacts  o-f  decisions.  How¬ 
ever,  as  we  pointed  out  in  Chapter  2,  getting  accurate  cost 
estimates  o-f  R2<D  programs  i  s  at  best  a  risky  business.  On 
the  other  hand,  it  may  be  possible  to  do  some  "what  if" 
analysis  by  displaying  possible  funding  curves  to  the  deci¬ 
sion  maker.  In  this  way,  the  decision  maker  can  specify  the 
time,  the  overall  dollar  value  of  the  programs,  and  pick  an 
appropriate  shape  of  the  funding  curve.  From  this  a  suita¬ 
ble  computer  program  can  calculate  the  yearly  funding 
requirements  for  the  program.  Again,  we  stress  that  this  is 
but  a  tool  to  aid  the  decision  maker  in  gaining  further 
insight  into  the  impact  of  his  decisions.  However,  the 
accuracy  of  the  cost  estimates  is  indeed  uncertain.  Because 
of  this,  this  type  of  analysis  should  be  accompanied  by  a 
great  deal  of  sensitivity  analysis. 

On  the  next  page  is  an  example  of  a  funding  curve.  The 
decision  maker  would  be  prompted  for  the  total  time  and 
total  budget  for  the  program.  He  would  also  be  required  to 
specify  the  percentage  of  the  total  budget  that  would  be 
needed  in  each  quarter  of  the  total  time. 

The  decision  maker  specifies  the  total  time  and  total 
budget  for  this  funding  profile.  He  also  specifies  the  25%, 
45%,  20%,  and  10%  of  the  total  budget  for  each  quarter  of 


Figure  H-l.  Sample  Funding  Curve 

For  example,  if  the  total  budget  was  specified  as 
*1,000,00(3  for  a  four  year  program,  then  for  the  first  year 
*250,000  would  be  needed,  the  second  year  would  need 
*450,000,  the  third  year  would  need  *200,000,  and  the  final 
year  would  require  *100,000. 

The  level  of  sophistication  (i.e.,  the  number  of  possi¬ 
ble  funding  curves  and  the  fine  tuning  of  time  and  budget) 
can  always  be  increased.  However,  from  our  research  of  the 
literature  (in  Chapter  Two),  simple  techniques  such  as  the 
one  described  above  are  probably  adequate  to  pursue  "what 
if"  types  of  analyses.  The  decision  maker  should  be  in¬ 
volved  in  specifying  the  types  of  budget  curves  that  are 
most  appropriate  for  this  type  of  analysis.  The  emphasis 
once  again  should  be  on  decision  support.  These  curves 
should  aid  the  decision  maker  in  performing  “what  if" 
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Appendix  I:  Analytic  Hierarchy  Process  Calculations 

This  appendix  brie-fly  describes  the  mathematical  calcu¬ 
lations  required  to  determine  a  priority  vector  from  a 
positive  reciprocal  matrix.  The  reader  should  refer  to 
Saaty  C198j  2031  for  the  theoretical  development  of  the 

analytic  hierarchy  process. 

A  postive  reciprocal  matrix  is  a  square  matrix  having 
the  following  properties: 

Let  matrix  A  =  a(i,j)  where  i,j  =  l,...,n 
Property  1:  a(i,j)  >0  for  all  i,j  =  l,...,n 

Property  2:  a<i,j)  =  l/a(j,i)  for  all  i,j  =  l,...,n 

It  is  easy  to  demonstrate  that  these  two  properties 
define  a  positive,  reciprocal,  square  matrix. 

To  determine  the  priority  vector  for  a  given  positive, 
reciprocal  matrix,  the  principal  eigenvector  is  computed. 
One  begins  with  a  matrix  A  of  real  numbers,  representing  the 
pairwise  comparisons  of  the  importance  of  the  elements  of 
one  level  in  the  hierarchy  with  respect  to  one  element  of 
the  next  higher  level,  and  finds  the  largest  eigenvalue  and 
determines  the  solution  of  the  equation 
Aw  =  (  \  max ) w 

where  (  X  max)  is  the  largest  eigenvalue.  The  priority 
vector  is  the  vector  w  after  w  has  been  normalized.  Al¬ 
though  computer  solution  is  the  preferred  method  1203:19], 
Saaty  identifies  four  methods  to  approximate  the  priority 
vector.  These  are  repeated  here  1203:191. 
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1.  (The  crudest)  Sum  the  elements  in  each  row 
and  normalize  by  dividing  each  sum  by  the  total  of 
all  the  sums,  thus  the  results  now  add  up  to 
unity.  The  first  entry  of  the  resulting  vector  is 
the  priority  of  the  first  activity;  the  second  of 
the  second  activity  and  so  on. 

2.  (Better)  Take  the  sum  of  the  elements  in  each 
column  and  form  the  reciprocals  of  these  sums.  To 
normalize  so  that  these  numbers  add  to  unity, 
divide  each  reciprocal  by  the  sum  of  the 
reciprocal s. 


3.  (Good)  Divide  the  elements  of  each  column  by 
the  sum  of  that  column  (i.e.,  normalize  the 
column)  and  then  add  the  elements  in  each  re¬ 
sulting  row  and  divide  this  sum  by  the  number  of 
elements  in  the  row.  This  is  a  process  of  aver¬ 
aging  over  the  normalized  columns. 

4.  (Good)  Multiply  the  n  elements  in  each  row 
and  take  the  nth  root.  Normalize  the  resulting 
numbers. 

To  obtain  an  approximate  value  for  the  consistency  of 


the  matrix: 


1.  Multiply  the  matrix  of  comparisons  (A)  on  the 
right  by  the  estimated  solution  vector  (found  in 
one  of  the  four  ways  above  or  by  computer).  This 
results  in  a  new  vector. 

2.  Divide  the  first  component  of  this  new  vector 
by  the  first  component  of  the  estimated  solution 
vector,  the  second  component  of  the  new  vector  by 
the  second  component  of  the  estimated  solution 
vector  and  so  on.  This  results  in  yet  another 
vector . 


3.  Take  the  sum 
vector  and  divide 
This  is  an  appro 
called  the  maximum 
number  is  used  in 
reflected  in  the 
The  closer  (  X 
activities  in  the 
the  result. 


of  the  component 
by  the  number  of 
ximation  to  the 
or  principal  ei 
estimating  the 
proportional i ty 
max)  is  to  n 
matrix)  the  mor 


s  of  this  third 
components  (n) . 
number  (  A  max) 
genvalue.  This 
consistency  as 
of  preferences, 
(the  number  of 
e  consistent  is 


4.  Deviation  from  consistency  may  be  represented 
by 

(  A  max  -  n ) / (n-1 ) , 


(  A  max 
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which  is  called  the  consistency  index  (C.I.). 

5.  The  consistency  index  of  a  randomly  generated 
reciprocal  matrix  -from  the  scale  1  to  9,  with 
reciprocals  Forced,  is  called  the  random  index 
(R.I.).  The  ratio  of  C.I.  to  R.I.  -for  the  same 
order  matrix  is  called  the  consistency  ratio 
(C.R.).  A  consistency  ratio  o-f  0.10  or  less  is 
considered  acceptable  1203: 211. 

A  short  table  o-f  R.I.  follows: 


R.  I. 

=1 

0.  00 

9 

0.00 

O 

0.58 

4 

0.90 

5 

1.  12 

6 

1.24 

7 

1.32 

8 

1.41 

9 

1.45 

10 

1.49 

11 

1.51 

12 

1.48 

13 

1.56 

14 

1.57 

15 

1.59 

Computer  Programs: 

Saaty  1198:252—2763  includes  several  short  computer 
routines  in  various  computer  languages  that  perform  the 
required  calculations  for  determining  the  priority  vectors 
and  measure  of  consistency. 

We  used  Expert  Choice  in  our  exercise  described  in 
Chapter  Seven.  A  listing  from  Expert  Choice  is  included  in 
Appendix  0.  Expert  Choice  is  produced  by  Decision  Support 


Software,  Inc., 


McLean,  VA,  for  the  IBM  personal  computer. 


Appendix  J:  Group  Decision  Making  with  the  Analytic 

Hierarchy  Process 

In  Chapter  Six  we  described  how  histograms  o-f  a  groups’ 
pairwise  comparisons  could  be  used  to  aid  the  decision  maker 
in  determining  those  areas  where  consensus  or  disagreement 
was  predominant.  Once  these  areas  are  identified  the  deci¬ 
sion  maker  can  redirect  the  efforts  of  the  group  to  focus 
their  dialogue  on  those  pairwise  comparisons  where  no  con¬ 
sensus  can  be  reached.  Obviously,  the  amount  of  information 
available  in  the  pairwise  comparisons  for  a  group  problem 
solving  session  can  be  rather  large  depending  on  the  sice  of 
the  group  and  the  size  of  the  hierarchies  used  in  the  AHP. 
Automating  the  display  of  these  histograms  would  greatly  aid 
the  efficiency  of  the  group  problem  solving  process. 

Other  types  of  information  that  can  be  presented  to  the 
group  members  to  aid  them  in  the  decision  making  process  are 
described  below. 

Members  weighting  of  the  alternative  (i.e.,  deter¬ 
mining  the  priority  vector  as  described  in 

Appendix  I ) . 

Smallest  group  weighting. 

Largest  group  weighting. 

Group  average  weighting. 

Members  consistency'  (as  calculated  from  computer 

routine  or  as  described  in  Appendix  I). 

Group  smallest  consistency. 

Group  largest  consistency. 


Group  average  consistency. 


The  following  demographic  data  was  provided  by  the  par 


ticipants  in  the  exercise  (Chapter  Seven). 


floe  20-29  X  X 

30-39  X  X 

40-49  X  X  X  X 


Educational  Background 
Participant:  1  2 

X  X 


B.S. 

M.S. 

PhD. 


X 

X 

X* 


X 

X 


6 

X 


7 

X 


8 


X 

X 


(X*  All  but  the  dissertation  has  been  completed) 


How  the  participants  described  themselves 
Participant:  12345 


6  7 


8 


Scientist 
Engineer 
Supervisor  or  Manager 
Technology  Manager 
Dec i si  on  maker 
Technology  Strategist 
Power  Systems  Analyst 
Program  Management 


X 

X 


X 

X 

X 

X 


X 

X 


X 

X 

X 

X 

X 


Self-Evaluation  of  the  participants  as  to  their  expertise. 
Each  participant  rated  himself  as  to  how  much  of  an  expert 
he  was  in  each  of  these  technology  disciplines  as  compared 
to  others  in  these  disciplines. 


K— 1 


Nat  at  all  1  X 

2  XX 

3  XX 
Somewhat  4  XX 

5  X 

6 

Very  Much  7 


Thermal  Control 

Not  at  al 1  1  X 

2  XXX 

3  X 
Somewhat  4  X 

5  XX 

6 

Very  Much  7 


Electro-Ootics 

Not  at  al 1 


Somewhat 


Very  Much 


1 

2 

3 

4 

5 

6 
7 


X 

X 

X  X  X  X 

X 

X 


In-formation  Processing 


Not  at  al 1  1 
2 
3 

Somewhat  4 

5 

6 

Very  Much  7 


Survi vabi 1 i tv 


Not  at  al 1 


Somewhat 


Very  Much 


1 

2 

3 

4 

5 

6 
7 


X 

X 

X 

X  X 
X  X 
X 


X 

X 

X 

X 


K-2 


„  wj  t"J  v.l1,  IF)' 


Material s 


Not  at  all  1 
2 
3 

Somewhat  4 

5 

6 

Very  Much  7 


X 

X 

X 

X 


Environment 


Not  at  all  1 
2 
3 

Somewhat  4 

5 

6 

Very  Much  7 


X  X 
X  X 
X 

X 

X  X 


Communications 

Not  at  al 1  1 
2 
3 

Somewhat  4 

5 

6 

Very  Much  7 


X  X 
X 

X  X  X  X 
X 


Manuf  ac tur i no 

Not  at  all  1 

2 

3 

Somewhat  4 

5 

6 

Very  Much  7 


XXX 

X 

X 

X  X 
X 


Test  and  Evaluation 

Not  at  all  1 
2 
3 

Somewhat  4 

5 

6 

Very  Much  7 


X  X 

XXX 

X 

X  X 
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Structures 


Not  at  all  1 
2 
3 

Somewhat  4 

5 

6 

Very  Much  7 


Man— In-Soace 

Not  at  all  1 

2 

3 

Somewhat  4 

5 

6 

Very  Much  7 


Radar 

Not  at  al  1  1 
2 
3 

Somewhat  4 

5 

6 

Very  Much  7 


Power /Energy 

Not  at  all  1 
2 
3 

Somewhat  4 

5 

6 

Very  Much  7 


Guidance/Navi aat ion 


X  X 
X  X 
X 

X  X 
X 


X  X 
X  X 
X  X 
X  X 


X  X 
X 

X  X 
X  X 
X 


X 

X 

XXX 

X 

X  X 


&  Control 


Appendix  L:  Technology  Issue  Assessment  Exercise 

Instructions 


Purpose  and  Objective  of  the  Exercise: 

Introduction: 

Thank  you  -for  taking  time  from  your  busy  schedules  to 
help  us  in  our  thesis  effort.  We  hope  that  your  participa¬ 
tion  will  also  contribute  to  STC’s  continuing  efforts  in 
managing  Air  Force  space  technologies. 

Purpose: 

The  purpose  of  this  exercise  is  to  obtain  feedback  on 
the  proposed  methodology  and  criteria  for  assessing  and 
prioritizing  space  technology  issues. 

Ob iecti ves: 

1-  Determine  the  validity,  adequacy,  and  usefulness  of  the 
proposed  hierarchical  structuring  of  the  problem. 

2.  Determine  the  validity,  adequacy,  and  usefulness  of  the 
proposed  criteria  for  assessing  space  technology  issues. 

3.  Determine  the  appropri ateness  of  this  quantitative 
approach  for  eliciting  subjective  judgments  from  space 
technology  experts. 

4.  Determine  if  the  information  currently  exists  in  order 
to  apply  the  criteria  in  the  assessment  process. 

Description  of  the  Exercise: 

This  exercise  consists  of  two  parts.  First,  you  will  be 
asked  to  apply  the  criteria  using  the  Analytic  Hierarchy 
Process  (described  later)  to  a  subset  of  space  technology 
issues  in  your  area  of  expertise  and  also  to  a  subset  of 
issues  from  a  mix  of  disciplines. 

Second,  the  results  of  this  exercise  will  be  presented 
to  you  as  well  as  the  group  results.  You  may  change  your 
assessment  at  this  time  if  the  results  so  indicate.  Once 
you  are  satisfied  with  the  results  and  understand  the  pro¬ 
cess  you  will  be  asked  to  fill  out  a  questionnaire.  The 
quest i onnai re  is  designed  to  get  your  feedback  on  using  the 
methodol ogy . 


The  intent  of  this  exercise  is  not  to  prioritize  space 
technology  issues  but  rather  to  understand  and  assess  the 
proposed  methodology.  However,  to  do  this  you  are  asked  to 


try  to  apply  the  proposed  structure  and  criteria  to  a  set  of 
space  technology  issues. 

The  results  o-f  this  exercise  will  be  used  in  a  non¬ 
statist  i cal  assessment  o-f  the  proposed  methodology.  Only 
descriptive  statements  o-f  the  results  and  the  answers  to  the 
questionnaire  will  be  used  in  our  thesis. 

Assessment  Process: 

Captain  Chapman  will  explain  the  assessment  process  and 
present  the  proposed  hierarchy.  Please  do  not  change  the 
structure  o-f  the  problem.  We  are  trying  to  assess  the 
methodology  rather  than  come  up  with  a  "correct"  list  o-f 
prioritized  technology  issues. 

Matrices  are  presented  to  you  in  order  to  make  pairwise 
comparisons  o-f  time  -frames  (technology  availability  dates), 
criteria,  and  space  technology  issues.  A  Scale  is  presented 
below  that  will  be  used  in  quantitatively  describing  the 
relative  importance  o-f  items  to  each  other. 

The  Analytic  Hierarchy  Process  (AHP)  is  the  multiple 
criteria  decision  making  technique  we  have  chosen  to  imple¬ 
ment  and  elicit  the  subjective  preferences  o-f  the  space 
technology  experts  in  the  context  o-f  the  criteria.  On  the 
next  page  is  the  scale  to  be  used  in  the  pairwise  comparison 
of  space  technology  issues. 

Only  the  upper  right  hand  portion  of  each  matrix  must 
be  filled  in.  If  the  item  in  the  left  hand  column  is  more 
important  than  the  item  across  the  top,  then  a  positive 
number  is  entered  from  the  scale.  If  the  item  in  the  left 
hand  column  is  less  important  than  the  item  across  the  top, 
then  a  negative  number  is  entered  from  the  scale.  Remember, 
the  pairwise  comparisons  are  done  in  terms  of  which  element 
dominates  another.  An  example  is  presented  below: 


C 
3 
6 
1 

Interpretation : 


A  B 
A  1  3 

B  1 

C 


Element  A  is  slightly  more  important  than  element  B. 


Element  C  is  slightly  more  important  than  element  A 
(note  -3) . 


Element  C  is  between  strongly  and  very  strongly  more 
tant  than  element  B  (again  represented  by  -6). 


cale  of  Relative  Importance  used  in  the  AHP 


impor 


sity  o-f 


tance 


De-f  i  ni  ti  on 


Equal  Importance 


Slight  importance 
of  one  over  another 


Essential  or  strong 
i mportance 


Demonstrated  impor¬ 
tance 


Absolute  importance 


Explanation 


Two  activities  contribute 
equally  to  the  objective 


Experience  and  judgment 
slightly  favor  one 
activity  over  another 

Experience  and  judgment 
strongly  favor  one 
activity  over  another 

An  activity  is  strongly 
favored  and  its  dominance 
is  demonstrated  in 
practice 

The  evidence  favoring  one 
activity  over  another  is 
of  the  highest  possible 
order  of  affirmation 


,4,6,8 


}eci procal « 
jf  above 
ion— zero 
lumbers 


Intermediate  values 
between  the  two 
adjacent  judgments 


When  compromise  is 
needed 


If  an  activity  has  one  of  the  above  numbers 
assigned  to  it  when  compared  with  a  second 
activity,  then  the  second  activity  has  the 
reciprocal  value  when  compared  to  the  first. 


Figure  L— 1.  AHP  Scale  of  Relative  Importance 


Prooosed  Hierarch 


Broad  Technology  Base 
to  meet  current  and  -future 
space-rel ated  operational  needs 


PI anni ng 
Hor  i  z  on : 


Present 

Term 

1985-1990 


Near 

Term 

1991-1995 


Mid 

Term 

1996-2000 


Far 
Term 
2001  + 


Criteria:  Supports  known 
and  projected 
mi ssi on 
requirements 


Broad 

appl ication 
Revol uti onary 
appl i cat ions 


Hedge 
agai net 
tech  surprise 
and  uncertainty 


Technology  TI 
Issues:  1 


Figure  L-2.  AHP  Hierarchy  for  Technology  Assessment 


The  question  to  ask  yourself  when  comparing  time  frames 
to  the  ultimate  goal  of  a  broad  technology  base  responsive 
to  operational  needs:  of  the  two  (pairwise  comparison)  time 
frames  being  compared,  which  is  considered  more  important 
with  respect  to  the  ultimate  goal. 

The  question  to  ask  yourself  when  comparing  criteria  to 
time  frames  is:  of  the  two  criteria  being  compared,  which 
is  Considered  more  important  in  that  time  frame,  and  how 
much  more  important  is  one  to  the  other. 

The  question  to  ask  yourself  when  comparing  space  tech¬ 
nology  issues  to  each  criterion  is:  of  the  two  technology 
issues  being  compared,  which  is  considered  more  important 
with  respect  to  the  criterion,  and  how  much  more  important 
is  one  to  the  other. 


Criteria  for  Eliciting  the  Subjective  Pre-ferences  of  Space 
Technology  Experts 


We  now  identity  and  explain  the  three  criteria  to  be 
used  in  the  analysis  o-F  the  strategic  and  technical  utility 
o-f  various  space  technology  issues  in  the  context  of  Space 
Technology  Advocacy. 


Criterion  1:  Provide  performance  levels  necessary  to  meet 
the  threat  and/or  projected  threat  within  the  space  arena. 
How  far  does  the  technology  issue  go  in  supporting  known  or 
projected  mission  requirements  and  tasks? 

Cr i ter i on  2:  Provide  alternative  applications  to  meet  many 
military  tasks.  What  is  the  potential  for  exploiting  the 
technology  issue  for  broad  applications  to  as  yet  unidenti¬ 
fied  tasks?  What  is  the  potential  in  the  technology  issue 
for  allowing  us  to  do  current  tasks  in  new  and  unexpected 
ways? 

Criterion  3:  Provide  a  "hedge"  against  technological  sur¬ 
prise  and  uncertainty. 


Explanation  of  each  of  the  criteria  follows: 


Explanation  of  the  Criteria 
Criterion  1: 

1 .  Provide  performance  levels  necessary  to  meet  the  threat 
and/or  projected  threat  within  the  space  arena.  In  other 
words,  how  far  does  the  technology  issue  go  in  supporting 
known  mission  requirements  and  tasks.  In  some  cases  this 
can  be  quantitatively  described.  The  presence  of  a  short¬ 
fall  in  performance  level  would  indicate  the  existence  of 
one  or  more  technology  issues.  This  criterion  allows  the 
decision  maker  to  compare  two  technology  issues  in  the 
context  of  how  important  is  one  to  the  other  in  terms  of  the 
quality  provided  by  the  technology  issues  to  the  successful 
accomplishments  of  military  tasks.  This  assessment  would  be 
partly  based  on  the  application  of  these  technology  issues 
to  various  military  functions  and  tasks  and  to  the  relative 
importance  of  these  functions  and  tasks  to  each  other. 
The  relative  importance  of  functions,  tasks,  and  missions 
can  be  derived  in  several  fashions. 

First,  mission  area  analysis  from  DoD,  the  Air  Staff, 
and  MAJCOM’s  can  aid  the  decision  maker  in  making  the 
assessment.  Also,  policy  statements  from  national  leaders. 
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both  civilian  and  military,  can  give  the  decision  maker  some 
insight  into  the  relative  importance  of  various  missions  and 
tasks.  Other  sources  -for  this  in-formation  are  the  planning 
documents  that  exist  within  DoD  and  the  Air  Force.  The 
Space  Systems  Architecture  study  is  one  such  document. 
Finally,  the  knowledge  and  experience  o-f  the  decision  maker 
is,  in  the  end,  the  most  important  source  of  in-formation  and 
judgment  -for  making  the  assessment. 


Criterion  2: 

2.  Provide  alternative  applications  to  meet  many  military 
tasks.  In  other  words,  what  is  the  potential  -for  exploiting 
the  technology  issue.  This  is  a  good  criterion  to  weight 
those  fledgling  technologies  that  may  have  application  to  as 
yet  unidentified  tasks  and  to  allow  us  to  do  current  tasks 
in  new  and  unexpected  ways.  Also,  this  criterion  can  be 
used  to  weight  those  technology  issues  that  can  revolution¬ 
ize  the  way  we  do  things  in  space. 

For  example,  let’s  take  a  look  at  laser  technology.  Not 
only  does  the  laser  have  application  in  the  future  as  a 
weapon  but  it  also  has  applications  in  laser— gyros,  laser 
range-finders,  laser  target  designators,  not  to  mention  the 
hundreds  of  civilian  applications  of  the  laser.  However, 
many  of  these  applications  could  not  be  forecast  twenty 
years  ago.  But  most  researchers  knew  there  was  great 
promise  in  this  technology  even  though  the  applications 
could  not  be  identified.  In  other  words,  a  laser  technology 
issue  may  be  robust  in  the  number  of  possible  applications 
that  can  flow  from  it.  Some  of  these  applications  may  not 
be  recognizable  or  have  been  identified  until  well  after  the 
maturity  of  the  technology.  However,  in  many  cases  the 
applications  that  have  been  identified  are  only  the  tip  of 
the  iceberg. 


Criterion  3: 

3.  Provide  a  "hedge”  against  technological  surprise  and 
uncertainty.  In  the  space  technology  advocacy  problem  the 
fact  that  a  program  or  technology  issue  is  high  risk  and/or 
uncertain  may  be  a  good  reason  to  go  ahead  and  budget  for  it 
in  order  to  reduce  the  uncertainty.  Sometimes  the  high 
risk/high  payoff  technology  is  the  one  to  pursue  in  terms  of 
satisfying  future,  and  possibly  unidentified,  mission  re¬ 
quirements.  For  example,  some  of  the  SDI  technology  issues 
are  important  to  investigate  because  their  resolution  will 
determine  the  very  feasibility  of  the  concept  of  Ballistic 
Missile  Defense  (BMD) .  Determining  this  feasibility  will 
have  a  major  impact  on  future  defense  options  and  will 
definitely  have  a  tremendous  impact  on  the  national  budget. 


This  criterion  is  also  important  in  the  sense  that  it  helps 
identify  those  areas  of  research  that  are  worth  doing  just 
for  the  sake  of  reducing  uncertainty.  Finally,  if  potential 
adversaries  are  involved  in  certain  technology  areas  we  may 
be  obliged  to  undertake  equivalent  research  in  order  to 
hedge  against  a  potential  technology  disadvantage. 


Summary:  From  this  description  it  becomes  readily  apparent 
that  these  three  criteria  are  extremely  difficult  if  not 
impossible  to  measure  quantitatively.  Whether  or  not  a 
technology  issue  contributes  more  or  less  to  these  criteria 
is  a  subjective  appraisal.  However,  this  exercise  and  your 
feedback  will  help  us  determine  the  validity  of  using  these 
criteria  in  eliciting  subjective  preferences  and  judgments 
from  space  technology  experts. 
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Appendix  M:  Exercise  Interview  Schedule  (Questionnaire) 


Interview  Schedule 


Now  that  you  have  made  the  space  technology  assessments, 
we  would  like  your  opinion  on  a  number  of  questions. 

Instructions 

The  questions  should  take  no  more  than  15  minutes  o-f 
your  time  to  answer. 

The  opinions  you  express  will  be  used  to  evaluate  the 
methodology  we  have  proposed  for  space  technology  advocacy 
in  our  thesis  effort. 

None  of  the  questions  require  you,  nor  are  they  intended 
for  you,  to  look  up  data  or  other  information. 

We  suggest  that  you  answer  the  questions  quickly  after 
reading  them  carefully.  Only  your  reactions  are  sought. 

If  you  should  wish  to  amplify  a  question  or  to  ask  a 
question  about  an  item,  please  feel  free  to  do  so. 

We  will  apply  the  principle  of  non-attribution.  The 
identity  of  individuals  responding  to  our  questionnaire  will 
not  be  revealed.  Your  name  will  not  be  associated  with  any 
information  you  provide.  Strict  anonymity  will  be 
maintained  throughout  the  study. 


Job  Title 


Age  _  20-29  _ 30-39  _ 40-49  _ 50+ 

Educational  Background  (multiple  answers  are  OK) 

B.S.  _  Major  field  _ 

M.S.  _  _ 

PhD.  _  _ 

Other  (specify)  _  ______ 

In  which  of  the  following  space  technology  disciplines  do 
you  consider  yourself  an  expert  or  specialist?  Please 
circle  the  scale  to  indicate  the  extent  to  which  you  think 
of  yourself  as  a  specialist  or  expert  (relative  to  others  in 


your  field) 


Autonomy 

Not  at  al 1 

1  2 

3 

Somewhat 

4 

5 

6 

Very  much 

7 

Thermal  Control 

Not  at  al 1 

1  2 

3 

Somewhat 

4 

5 

6 

Very  much 

7 

El ectro-ODtics 

Not  at  al 1 

1  2 

3 

Somewhat 

4 

5 

6 

Very  much 

7 

In-formation  Processinq 

Not  at  al 1 

1  2  3 

Somewhat 

4 

5 

b 

Very  much 

7 

Survi vabi 1 i ty 

Not  at  al 1 

1  2 

3 

Somewhat 

4 

5 

6 

Very  much 
7 

Material s 

Not  at  al 1 

1  2 

3 

Somewhat 

4 

5 

b 

Very  much 
7 

Environment 

Not  at  al  1 

1  2 

Somewhat 

4 

5 

6 

Very  much 
7 

Commun i cat i on  s 

Not  at  all 

1  2 

3 

Somewhat 

4 

5 

b 

Very  much 
7 

Manu-f  actur  inq 

Not  at  all 

1  2 

3 

Somewhat 

4 

5 

b 

Very  much 
7 
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Test  and  Evaluation 


Not  at  all 

1  2 


Somewhat 

3  4  5 


Very  much 
6  7 


Structures 


Not  at  al  1 

1  2 


Somewhat 

4 


Very  much 
6  7 


Man-ln-Space 


Not  at  al  1 

1  2 


Somewhat 

3  4  5 


Very  much 
6  7 


Radar 


Not  at  al 1 

1  2 


Somewhat 

4 


Very  much 
6  7 


Power /Enert 


Not  at  al  1 

1  2 


Somewhat 

4  5 


Very  much 
6  7 


Guidance/Navi gat ion  &  Control 


Not  at  al 1 
1 


Somewhat 

3  4  5 


Very  much 
a  7 


Weapons 


Not  at  all 

1  2 


Somewhat 

4 


Very  much 
6  7 


Propulsion 


Not  at  all 

1  2 


Somewhat 

4 


Very  much 
6  7 


Other  (specify) 

Not  at  all 

1  2 


Somewhat 

4 


Very  much 
6  7 


V  V JV  V_\-  V.'.v  V  V.-  ■  -  -■  •.-•.-V 
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Would  you  describe  yourself  primarily  as  (more  than  one 
answer  is  OK)  (Check  the  appropriate  items). 


Scientist  ___ 

Engineer  _ 

Supervisor  or  Manager  _ 

Technology  Manager  _ 

Decision  maker  __ 

Technology  Strategist  _ 

Other  (specify)  _ 

Were  you  familiar  with  the  Analytic  Hierarchy  Process  (prior 
to  this).  Indicate  the  level  of  familiarity  on  the  fol¬ 
lowing  scale. 

Not  at  all  Somewhat  Very  much 

1  2  3  4  5  6  7 


Have  you  ever  used  the  Analytic  Hierarchy  Process  as  an  aid 
for  selecting  or  assessing  possible  alternatives  (in  any 
aspect  of  your  job  or  profession)? 

Not  at  al 1  Somewhat  Very  much 
1  2  3  4  5  6  7 


Do  you  currently  use  any  formalized  method  or  technique  for 
assessing  or  prioritizing  technology  issues? 

Yes  _ 

No 


For  the  following  questions,  circle  the  number  which  best 
indicates  your  evaluation  of  each  statement. 


I  understood  what  I  was  required  to  do  for  this  exercise  in 
assessing  the  space  technology  issues. 


1 

2 

3 

4 

5 

not  at 

not  very 

somewhat 

fairly 

very 

all  clear 

clear 

clear 

clear 

clear 

I  am  now  using  or  have 
in  my  work  for  setting 

1  2 

used  quantitative 
priorities. 

3  4 

anal yti cal 

5 

methods 

much  too 

too 

about 

too 

much 

too 

little 

little 

right 

much 

much 
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The  description  of  Criterion  1  made  sense  to  me. 


1  2  3 

strongly  disagree  not 

d  i  sagr  ee  sur  e 


4  5 

agree  strongly 

agree 


The  description  of  Criterion  2  made  sense  to  me. 


1  2  3 

strongly  disagree  not 

disagree  sure 


4 

agree 


5 

strongly 

agree 


The  description  of  Criterion  3  made  sense  to  me. 


1  2  3 

strongly  disagree  not 

disagree  sure 


4 

agree 


5 

strongly 

agree 


The  Hierarchy  is  appropriate  for  this  type  of  analysis. 


1  2  3 

strongly  disagree  not 

disagree  sure 


4 

agree 


5 

strongly 

agree 


I  was  able  to  apply  Criterion  1  in  the  pairwise  comparison 
of  space  technology  issues. 

1  2  3  4  5 

strongly  disagree  not  agree  strongly 

disagree  sure  agree 


I  was  able  to  apply  Criterion  2  in  the  pairwise  comparison 
of  space  technology  issues. 

1  2  3  4  5 

strongly  disagree  not  agree  strongly 

disagree  sure  agree 


I  was  able  to  apply  Criterion  3  in  the  pairwise  comparison 
of  space  technology  issues. 

1  2  3  4  5 

strongly  disagree  not  agree  strongly 

disagree  sure  agree 


The  results  o-f  the  assessment  are  close  to  how  I  would  rank 
order  the  space  technology  issues  in  order  o-f  importance. 


1 

strongly 
di sagree 


2  3 

disagree  not 

sure 


4 

agree 


5 

strongly 

agree 


The  three  criteria  represent  a  good  way  to  evaluate  the 
potential  military  strategic  and  technical  utility  o-f  space 
technology  issues. 


1 

strongly 

disagree 


2  3 

disagree  not 

sure 


4 

agree 


5 

strongly 

agree 


I  would  consider  using  this  approach  in  the  future  in  a 
formalized  manner  to  assess  technology  issues. 


1  2 
strongly  disagree 

disagree 


3 

not 

sure 


4  5 

agree  strongly 

agree 


1  feel  qualified  to  use  these  three  criteria  in  assessing 
space  technology  issues. 


1 

strongly 
di sagree 


2  3 

disagree  not 

sure 


4 

agree 


%j 

strongly 

agree 


I  feel  qualified  to  assess  technology  issues  in  terms  of 
military  doctrine. 


1 

strongly 
di sagree 


2  3 

disagree  not 

sure 


4 

agree 


5 

strongly 

agree 


The  information  available  to  me  about  the  space  technology 
issues  is  adequate  for  this  type  of  assessment  in  the  con¬ 
text  of  criterion  1. 


1  2 
strongly  disagree 

disagree 


o 

not 

sure 


4  5 

agree  strongly 

agree 
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The  in-formation  available  to  me  about  the  space  technology 
issues  is  adequate  tor  this  type  o-f  assessment  in  the  con¬ 
text  of  criterion  2. 


1  2  3  4  5 

strongly  disagree  not  agree  strongly 

disagree  sure  agree 


The  information  available  to  me  about  the  space  technology 
issues  is  adequate  for  this  type  of  assessment  in  the  con¬ 
text  of  criterion  3. 

1  2  3  4  5 

strongly  disagree  not  agree  strongly 

disagree  sure  agree 


Of  the  three 

criteria,  which  one  was  easiest 

to  apply? 

Criteria  1 

Criteria  2 

Criteria  3 

— 

Of  the  three 

criteria,  which  one  was  most 

difficult  to 

apply? 

Criteria  1 

Criteria  2 

Criteria  3 

— 

The  next  four 

statements  are  closelv  related 

so  please  read 

careful 1 v. 

The  ultimate  goal  for  resolving  space  technology  issues  is 
to  provide  a  broad  technology  base  to  meet  current  and 
future  operational  needs. 


1 

strongly 
di sagree 


2  3 

disagree  not 

sure 


4 

agree 


5 

strongly 

agree 


The  ultimate  goal  for  resolving  space  technology  issues 
to  provide  a  broad  technology  base  that  is  responsive 
operational  needs. 


i  s 
to 


1  2  3  4  5 

strongly  disagree  not  agree  strongly 

disagree  sure  agree 


The  ultimate  goal  for  resolving  space  technology  issues  is 
to  provide  a  broad  technology  base  that  is  responsive  to 
operational  needs  currently  known,  projected,  or  as  yet 
unidentified. 

1  2  3  4  5 

strongly  disagree  ndt  agree  strongly 

disagree  sure  agree 


The  ultimate  goal  for  resolving  space  technology  issues  is 
to  build  space  systems. 

1  2  3  4  5 

strongly  disagree  not  agree  strongly 

disagree  sure  agree 


I  feel  that  decisions  made  by  using  this  system  would  more 
closely  reflect  the  attitudes  and  beliefs  of  the  decision 
maker  than  if  I  did  not  use  the  system  and  arbitrarily 
developed  a  scoring  model. 

1  2  3  4  5 

strongly  disagree  not  agree  strongly 

disagree  sure  agree 


The  results  using  this  approach  are  the  same  that  I  would 
obtain  if  I  did  not  use  this  approach. 


1 

strongly 

disagree 


O 

disagree 


3 

not 

sure 


4  5 

agree  strongly 

agree 


The  results 
pri ori ti es 
programs. 


using  this  approach  would  be  valuable  in  setting 
for  budgetary  decisions  for  space  R&D  technology 


1 

strongly 

disagree 


2  3 

disagree  not 

sure 


4  5 

agree  strongly 

agree 


The  overall  quality  of  my  decisions  would  be  increased  by 
using  this  methodology  because  of  the  formalized  structure 
of  the  problem  and  the  criteria  used. 


2  3 

disagree  not 

sure 


5 

strongly 

agree 


1 

strongly 

disagree 


4 

agree 


This  method  requires  too  much  time  and  effort  to  compare  and 
prioritize  space  technology  issues. 


1  2  3 

strongly  disagree  not 

disagree  sure 


4  5 

agree  strongly 

agree 


The  measure  of  my  consistency  in  setting  space  technology 
issue  priorities  is  an  important  element  in  using  this 
approach. 

1  2  3  4  5 

strongly  disagree  not  agree  strongly 

disagree  sure  agree 


Consistency  is  important  to  me  when  making  decisions. 

1  2  3  4  5 

strongly  disagree  not  agree  strongly 

disagree  sure  agree 


The  information  required  for  this  type  of  analysis  does  not 
currently  exist. 

1  2  3  4  5 

strongly  disagree  not  agree  strongly 

disagree  sure  agree 


The  manner  in  which  technology  issues  are  currently  assessed 
is  adequate  and  should  not  be  changed. 

1  2  3  4  5 

strongly  disagree  not  agree  strongly 

disagree  sure  agree 


Technology  issues  need  to  be  assessed  and  prioritized  in  the 
context  of  the  three  criteria. 


1  2  3 

strongly  disagree  not 

disagree  sure 


4  5 

agree  strongly 

agree 


I  feel  qualified  to  assess  technology  issues  outside  my 
area(s)  of  expertise. 


1  2  3 

strongly  disagree  not 

disagree  sure 


4  5 

agree  strongly 

agree 


I  feel  qualified  to  assess  technology  issues  outside  my  area 
of  expertise  in  terms  of  the  three  criteria. 

1  2  3  4  5 

strongly  disagree  not  agree  strongly 

disagree  sure  agree 


After  participating  in  this  exercise  I  would  adopt  this 
methodology  and  the  criteria  whenever  I  must  make  an  assess~ 
ment  of  a  set  of  space  technology  issues. 


2  3 

disagree  not 

sure 


5 

strongly 

agree 


1 

strongly 

disagree 


4 

agree 


Appendix  N:  Listing  of  Space  Technology  Issues  Used  in  the 
Space  Technology  Assessment  Exercise 


The  -following  -four  sets  o-f  space  technology  issues  were 
used  in  the  exercise  to  elicit  the  subjective  preferences  of 
space  technology  experts.  The  -first  set  o-f  issues  were 
taken  from  the  space  power/energy  technology  discipline. 
The  second  set  are  space  materials  issues.  The  other  two 
sets  of  issues  reflect  a  mixture  of  issues  from  various 
space  technology  disciplines.  All  participants  assessed  at 
least  one  of  the  sets  below. 


Space  Power /Energy  Issues 

El ectrochemi cal  Energy  Storage 
Advanced  Survivable  Solar  Array 
100  Kilowatt  Nuclear  Reactor 
Solar  Thermal  Dynamic  Power  System 
Multi  megawatt  Nuclear  Reactor 
Dynamic  Isotope  Power  System 
Nonnuclear  Prime  Power 


Space  Materials  Issues 

Metal  Matrix  Composites 
Organic  Matrix  Composites 
Vibration  Damping  Materials 
Adhesives,  Seals,  and  Sealants 
Space  Lubricants 

Printed  Wiring  Board  Substrates 
Electrical  Insulation  Materials 


First  Mixed  Set  of  Issues 

Laser  Cross  Links 
Ionospheric  Propagation 
Data  Processing 
Optics  Production 
IR  Focal  Plane 

Deployable/Erectable  Structures 
Autonomous  Satellite  Maintenance 


Second  Mixed  Set  o-f  Issues 


Laser  Survivability 

Manned  Performance  Enhancement 

Metal  Matrix  Composites 

Orbital  Transfer  Vehicle  Propulsion  Performance 
EHF  Nulling  Antenna 
Cryogenic  Ref rigerators 
Autonomous  Navigation 


I 
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*.  v\.v. 


■  /•  A  , 


The  -following  listing  is  the  output  from  the  commer¬ 
cially  available  AHP  software  called  Expert  Choice.  This 
listing  shows  how  the  space  technology  advocate  might  eval¬ 
uate  the  set  of  materials  issues  listed  in  Appendix  N.  The 
fallowing  abbreviations  were  used: 

Metal  Matrix  Composites  METMATRX 

Organic  Matrix  Composites  QRMATRXC 

Vibration  Damping  Materials  ViBDAMP 

Adhesives,  Seals,  and  Sealants  ADSEALS 

Space  Lubricants  LUBRICNT 

Printed  Wiring  Board  Substrates  WRNGSUBS 

Electrical  Insulation  Materials  ELINSULA 

Each  section  of  the  listing  identifies  the  level  of  the 
hierarchy  being  evaluated  with  respect  to  the  next  higher 
level.  Following  this  is  the  upper  half  of  the  matrix  of 
pairwise  comparisons.  Negative  values  (actual  1 y  the  recip¬ 
rocal  value)  are  identified  by  parenthesis.  Following  the 
matrix  is  the  weighted  priority  vector  along  with  a  histo¬ 
gram  show  the  relative  weightings.  The  inconsistency  ratio 
is  then  presented.  Finally,  an  overall  tally  of  the  evalua¬ 
tion  is  listed  followed  by  the  overall  priority  vector  and 
the  accompanying  histogram. 


JUDGMENTS  WITH  RESPECT  TO 

GOAL  OF  BROAD  TECHNOLOGY  BASE 

A  B  C  D 
A:  PRESTERM  5.0  9.0  9.0 

B:  NEARTERM  9.0  9.0 

C:  MIDTERM  9.0 

d:  FARTERM 

1  EQUAL  3  MODERATE  5  STRUNG  7  VERY  STRONG  9  EXTREME 

0.605 

PRESTERM  XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
0.  283 

NEARTERM  XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
0.085 

MIDTERM  XXXXXXXXXX 
0.027 

FARTERM  XXX 

INCONSISTENCY  RATIO  =  0.372 


JUDGMENTS  WITH  RESPECT  TO 
PRESTERM 

ABC 

A:  CRIT1  5.0  7.0 

B:  CRIT2  3.0 

C:  CRIT3 

1  EQUAL  3  MODERATE  5  STRONG  7  VERY  STRONG  9  EXTREME 

0.731 

CRIT1  XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
0.  188 

CRIT2  XXXXXXXXXXXXXXXXXX 

0 . 08 1 

CRIT3  XXXXXXXX 

INCONSISTENCY  RATIO  =  0.056 


JUDGMENTS  WITH  RESPECT  TO 
NEARTERM 


A:  CRIT1 
B:  CRIT2 
C:  CRIT3 


ABC 
3.0  5.0 

5.0 


1  EQUAL  3  MODERATE  5  STRONG  7  VERY  STRONG  9  EXTREME 


0.618 

CRIT1  XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
0.297 

CRIT2  XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

0.086 

CRIT3  XXXXXXXXXX 

INCONSISTENCY  RATIO  =  0.117 


JUDGMENTS  WITH  RESPECT  TO 
MIDTERM 


ABC 

A:  CR IT 1  (3.0) (3.0) 
B:  CRIT2  1.0 
c:  CRIT3 


1  EQUAL 


3  MODERATE  5  STRONG  7  VERY  STRONG  9  EXTREME 


0.  143 

CRIT1  XXXXXXXXXXXXXXXXXXXXXXX 

0.429 

CRIT2  XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

0 . 429 

CRIT3  XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

INCONSISTENCY  RATIO  =  0.000 


JUDGMENTS  WITH  RESFECT  TO 
FARTERM 


ABC 

A: 

CRIT1  (5.0) (5.0) 

B: 

CRIT2  1.0 

c: 

CRIT3 

1  EQUAL 

3  MODERATE  5  STRONG 

7  VERY  STRONG 

9  EXTREME 

0.091 

CRIT1  XXXXXXXXXXXXXX 


0.455 

CRIT2  xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 


0.  455 

CRIT3  xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

INCONSISTENCY  RATIO  =  0.000 


JUDGMENTS  WITH  RESFECT  TO 


CRIT1 

a 

BCD 

E 

F 

G 

a: 

METMATRX 

5.0  3.0  7.0 

5.0 

5.0 

5.0 

B: 

ORMATRXC 

(5.0)  3.0 

(5.0) 

1.0 

(3.0) 

C: 

VIBDAMP 

5.0 

3.0 

5.0 

3.0 

d: 

ADSEALS 

(5.0) 

1.0 

(3.0) 

E: 

LUBRICNT 

5.0 

3.0 

f: 

WRNGSUBS 

(3.0) 

g: 

ELINSULA 

1  EQUAL  3  MODERATE  5  STRONG  7  VERY  STRONG  9  EXTREME 


0.398 

METMATRX  XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 


0.050 

ORMATRXC  XXXXXXXXX 
0.229 

VIBDAMP  XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
0.034 

ADSEALS  XXXXXX 
0.  159 

LUBRICNT  XXXXXXXXXXXXXXXXXXXXXXXXXXXX 


0.  041 

WRNGSUBS  XXXXXXX 


0.  089 

ELINSULA  XXXXXXXXXXXXXXXX 

INCONSISTENCY  RATIO  =  0.073 


- » - » -i‘< " -  - 


0-4 


JUDGMENTS  WITH  RESPECT  TO 


CRIT2 

A 

BCD 

E 

F 

G 

a: 

METMATRX 

7.0  3.0  7.0 

3.0 

5.0 

5.0 

b: 

ORMATRXC 

<5.0>  1.0 

(5.0) 

3.0 

(3.0) 

c: 

VIBDAMP 

7.0 

3.0 

5.0 

3.0 

D: 

ADSEALS 

(5.0) 

1.0 

(3.0) 

E: 

LUBRICNT 

5.  0 

(3.0) 

f: 

WRNGSUBS 

(5.0) 

g: 

ELINSULA 

1  EQUAL  3  MODERATE  5  STRONG  7  VERY  STRONG  9  EXTREME 


0.380 

METMATRX  XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
0.047 

ORMATRXC  XXXXXXXXX 


0.237 

VIBDAMP  XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
0.036 

ADSEALS  XXXXXXX 


0.  125 

LUBRICNT  XXXXXXXXXXXXXXXXXXXXXXX 


0. 034 

WRNGSUBS  XXXXXX 
0.  142 

ELINSULA  XXXXXX XXXXXXXXXXXXXXXXXXXX 


INCONSISTENCY  RATIO 


0.  087 


JUDGMENTS 

WITH  RESFECT 

TO 

CRIT3 

A 

BCD 

E 

F 

G 

A: 

METMATRX  5 

.  0  3.0  5.0 

3.  0 

7.0 

3.  0 

b: 

ORMATRXC 

<5. 0)  1.0 

(5.0) 

1 . 0 

<5.0 

c: 

VIBDAMP 

5.0 

3.0 

7.0 

3.0 

d: 

ADSEALS 

(5.  0) 

3.0 

<3.0: 

e: 

LUBRICNT 

5.0 

3.0 

F : 

WRNGSUBS 

<5.0 

G: 

ELINSULA 

1  EQUAL 

3  MODERATE 

5  STRONG 

7  VERY  STRONG 

0.345 

METMATRX  XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXv 
0.  039 

ORMATRXC  XXXXXXXX 


0.249 

VIBDAMF  XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
0.049 

ADSEALS  XXXXXXXXXX 


0.  173 

LUBRICNT  XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
0 . 030 

WRNGSUBS  XXXXXX 


0.  114 

EL INSULA  XXXXXXXXXXXXXXXXXXXXXXX 


EXTREME 

<XXXXXXXXXXXXXXXXXX 


INCONSISTENCY  RATIO  =  0.069 


BROAD  TECHNOLOGY  BASE 
TALLY  FOR  LEVEL  3  NODES 


LEVEL  1 


PRESTERM  * 


NEARTERM  = 


LEVEL  2 

LEVEL  3 

LEVEL 

CRIT1 

442 

METMATRX 

176 

VIBDAMP 

= 

101 

LUBRICNT 

70 

EL  INSULA 

= 

39 

ORMATRXC 

- 

22 

WRNGSUBS 

= 

18 

ADSEALS 

S= 

15 

CRIT2 

114 

METMATRX 

43 

VIBDAMP 

= 

27 

ELINSULA 

= 

16 

LUBRICNT 

= 

14 

ORMATRXC 

= 

5 

ADSEALS 

= 

4 

WRNGSUBS 

= 

4 

CRIT3 

49 

METMATRX 

_ 

17 

VIBDAMP 

= 

12 

LUBRICNT 

= 

8 

ELINSULA 

6 

ADSEALS 

2 

ORMATRXC 

= 

2 

WRNGSUBS 

= 

1 

CRIT1 

174 

METMATRX 

. 

70 

VIBDAMP 

= 

40 

LUBRICNT 

=5 

2B 

ELINSULA 

= 

15 

ORMATRXC 

= 

9 

WRNGSUBS 

= 

7 

ADSEALS 

= 

6 

CRIT2 

84 

METMATRX 

t 

VIBDAMP 

20 

ELINSULA 

= 

12 

LUBRICNT 

* 

10 

ORMATRXC 

4 

ADSEALS 

= 

3 

WRNGSUBS 

= 

T, 

CR1T3 

24 

METMATRX 

_ 

8 

VIBDAMP 

* 

6 

LUBRICNT 

= 

4 

ELINSULA 

= 

3 

ADSEALS 

= 

i 

ORMATRXC 

■s 

i 

WRNGSUBS 

= 

i 

MIDTERM 


CRIT2 


37 


lV- 


f  . 

•  _  ^  zw~^r 

•^777^  .3  jp.  v  _  s',  •»-.  ir, 

i 

LEVEL  1 

LEVEL  2 

BROAD  TECHNOLOGY  BASE 

TALLY  FOR  LEVEL  3  NODES 

LEVEL  3  LEVEL  4  LEVEL  5 

j 

/  1 

'  ’ 

3 

■ 

METMATRX  = 

14 

i 

■ 

VIED AMP  = 

9 

ELINSULA  = 

5 

LUBRICNT  = 

5 

ORMATRXC  = 

2 

ADSEALS  = 

1 

■ 

CRIT3 

WRNGSUBS  = 

=  37 

METMATRX  = 

VI ED AMP  = 

1 

13 

9 

■r  -  1 

• 

LUBRICNT  = 

6 

ELINSULA  = 

4 

ADSEALS  = 

2 

•  .  •  .  * 

ORMATRXC  = 

1 

»• 

WRNGSUBS  = 

1 

* 

CRIT1 

=  12 

• 

METMATRX  * 

5 

VlEDAMP  = 

3 

LUBRICNT  *= 

2 

ELINSULA  = 

1 

ORMATRXC  = 

1 

WRNGSUBS  • 

1 

'ADSEALS  * 

6 1 

■ •/ 

s 

FARTERM  = 

. 

27 

CRIT2 

=  12 

■*  •  M 

METMATRX  = 

5 

■  • 

VIBDAMP  = 

3 

.* 

• 

ELINSULA  = 

2 

.  V« : 

« 

LUBRICNT  = 

<“> 

.**.** . 

s 

ORMATRXC  * 

1 

I 

ADSEALS  = 

0 

\  **.  j 

m 

1 

; 

CRIT3 

WRNGSUBS  •= 

=  12 

METMATRX  = 

0 

4 

•  -  --4 

VIBDAMP  «= 

3 

LUBRICNT  = 

ELINSULA  = 

1 

ADSEALS  = 

1 

ORMATRXC  = 

0 

n 

WRNGSUBS  = 

0 

r  - 

CRIT1 

*  2 

- . 

METMATRX  = 

1 

.  • 

* 

VIBDAMP  = 

1 

»* 

LUBRICNT  = 

0 
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0 
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ORMATRXC  * 

0 
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BROAD  TECHNOLOGY  BASE 


METMATRX  0.387 
VIBDAMP  0.233 
LUBRICNT  0.153 
EL INSULA  0.105 
ORMATRXC  0.048 
WRNGSUBS  0.038 
ADSEALS  0.036 

1 . 000 

ADSEALS  0. 036 
ELINSULA  0. 105 
LUBRICNT  0.153 
METMATRX  0.387 
ORMATRXC  0.048 
VIBDAMP  0.233 
WRNGSUBS  0.038 


LEVEL  3  NODES  SORTED  BY  PRIORITY 

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

xxxxxxxxxxxxxxxxxxxxxxxxx 

xxxxxxxxxxxxxxxxx 

xxxxxxxx 

xxxxxx 

xxxxxx 


LEVEL  3  NODES  SORTED  BY  NAME 


XXXXXX 

XXXXXXXXXXXXXXXXX 

xxxxxxxxxxxxxxxxxxxxxxxxx 

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

xxxxxxxx 

xxxxxxxx xxxxxxxxxxxxxxxxx xxxxxxxx xxxxx 
xxxxxx 


1 . 000 
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